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MECHANISM FOR MAPPING XML SCHEMAS TO OBJECT-RELATIONAL 

DATABASE SYSTEMS 
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FIELD OF THE INVENTION 
The present invention relates to techniques for storing XML data in a database 

system. 

BACKGROUND OF THE INVENTION 

Within a relational database system, data is stored in various types of data 
containers. Such data containers typically have a structure. The structure of a container 
is imposed on the data it contains. For example, tables are organized into rows and 
columns. When data is stored in a table, individual data items within the data are stored 
in the specific rows and columns, thus imposing a structure on the data. 

Typically, the structure imposed on the data corresponds to logical relationships 
within the data. For example, all values stored within a given row of a table will typically 
have some logical relationship to each other. For example, all values within a given row 
of an employee table may correspond to the same employee. 

Outside of database systems, the degree to which electronic data is structured may 
vary widely based on the nature of the data. For example, data stored in spreadsheets is 
generally highly structured, while data representing visual images is generally highly 
unstructured. 

XML (extensible Markup Language) is becoming increasingly popular as the 
format for describing and storing all forms of data. Thus, providing support for storing, 
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searching and manipulating XML documents is an extremely important problem for data 
management systems today. 

Information about the structure of specific types of XML documents may be 
specified in documents referred to as "XML schemas". For example, the XML schema 
for a particular type of XML document may specify the names for the data items 
contained in that particular type of XML document, the hierarchical relationship between 
the data items contained in that type of XML document, datatypes of the data items 
contained in that particular type of XML document, etc. 

Unfortunately, although XML documents are structured, the structure of XML 
documents is largely ignored by database systems when database systems are used to 
store XML documents. For example, a highly structured XML document, containing 
multiple values for multiple attributes, may simply be stored as if it were an atomic 
undifferentiated piece of data in a single CLOB column of a table. When XML 
documents are stored in this fashion, the performance and scalability features of the 
database cannot be fully exploited to access the XML data. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The present invention is illustrated by way of example, and not by way of 
limitation, in the figures of the accompanying drawings and in which like reference 
numerals refer to similar elements and in which: 

FIG. 1 is a block diagram of a database system that includes a mechanism for 
mapping constructs contained in XML schemas to object-relational constructs, according 
to an embodiment of the invention; 

FIG. 2 is a block diagram illustrating a computer system on which embodiments 
of the present invention may be implemented; 

FIG. 3 is a block diagram showing syntax for creating an XML type table, 
according to an embodiment of the invention; 

FIG. 4 is a block diagram showing a database system configured to create 
database objects for an appropriate database representation for documents conform to a 
particular XML schema, according to an embodiment of the invention; 

FIG. 5 is a block diagram showing that XML strings are selectively mapped to 
two alternative database-supported datatypes; 

FIG. 6 shows a complexType being mapped to SQL for out-of-line storage; 
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FIG. 7 shows complexType XML fragments mapped to character large objects 
(CLOBs); 

FIG. 8 showis cross-referencing between complexTypes in the same XML 
schema; 

FIG. 9 is a block diagram showing complexType self-referencing within an XML 
schema; and 

FIG. 10 is a block diagram showing cyclical references between XML schema. 

DETAILED DESCRIPTION OF EMBODIMENTS OF THE INVENTION 

A method and system are described for mapping XML schemas to object- 
relational database systems. In the following description, for the purposes of explanation, 
numerous specific details are set forth in order to provide a thorough understanding of the 
present invention. It will be apparent, however, that the present invention may be 
practiced without these specific details. In other instances, well-known structures and 
devices are shown in block diagram form in order to avoid unnecessarily obscuring the 
present invention. 

FUNCTIONAL OVERVIEW 
Various techniques are described herein for managing XML data within a 
database system in a manner that increases the correlation between the structure imposed 
on the data by the database containers used to hold the data, and the structure of the XML 
documents from which the data originates. According to one aspect, a mechanism is 
provided to allow users of a database system to register XML schemas with the database 
system. An XML schema may be registered explicitly (via an API call) or implicitly 
(when an instance document conforming to the XML schema is first inserted into the 
database). 

During the registration process for a given XML schema, the database system 
determines (1) an appropriate database representation for the XML schema and (2) 
mapping information. The "appropriate database representation" determination is a 
determination about how data that conforms to the XML schema should be managed by 
the database system. Determining the appropriate database representation for a given 
XML schema may involve, for example, determining the database objects, collection 
types, constraints, and even the indexes that are to be used by the database system to store 
data from XML documents that conform to the given XML schema. 
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The mapping information indicates the mapping between the constructs included 
in the XML schema and the constructs included in the appropriate database 
representation. The mapping information may indicate, for example, that data associated 
with a specific element of the XML schema should be stored in a particular column of a 
table that is generated as part of the appropriate database representation. Typically, the 
appropriate database representation and the mapping information are generated so as to 
create a high correlation between the structure described in the XML schema and the 
structure imposed on the data by the database containers in which the XML data is stored. 

SYSTEM OVERVIEW 

FIG. 1 is a block diagram of a system that includes a mechanism for mapping 
XML schemas to object-relational database systems. Specifically, a database server 104 
(also referred to herein as M XDB") includes an XML schema mapper 106. When an XML 
schema 102 is registered with database server 104, XML schema mapper 106 determines 
the appropriate database representation 108 for documents that conform to the XML 
schema 102, and generates mapping information 110 that indicates the correlation 
between the elements of the XML schema and the elements of the appropriate database 
representation 108. 

According to one embodiment, database server 104 is configured to: 

• Register any W3C compliant XML schema 

• Perform validation of XML documents against a registered XML schema 

• Register both local and global schemas 

• Generate XML schemas from object types 

• Support re-registering a XML schema (as a mechanism for manual schema 
evolution) 

• Support implicit registration of XML schema when documents are inserted via 
certain APIs (e.g. FTP, HTTP) 

• Allow a user to reference a schema owned by another user 

• Allow a user to explicitly reference a global schema when a local schema exists 
with the same name. 
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• Support XML schema evolution 

According to one embodiment, XML schema mapper 106 is configured to: 

• Generate structured database mapping from XML Schemas (typically during 
schema registration) - this may include, for example, generation of SQL object 
types, collection types, etc and capturing the mapping information via schema 
annotations. 

• Allow a user to specify a particular SQL type mapping when there are multiple 
legal mappings 

• Create XMLType tables and columns based on registered XML schemas 

• DML and query support for schema-based XMLType tables 

XML SCHEMA REGISTRATION 
According to one embodiment, an XML schema has to be first registered with 
database server 104 before it can be used or referenced within database server 104. After 
the registration process is completed, XML documents conforming to this schema (and 
referencing it via the schema URL within the document) can be handled by database 
server 104. Tables and/or columns can be created for root XML elements defined by this 
schema to store the conforming documents. 

According to one embodiment, a schema is registered using a 
DBMS_XMLSCHEMA package by specifying the schema document and its URL (also 
known as schema location). Note that the URL used here is simply a name that uniquely 
identifies the registered schema within the database - and need not be the physical URL at 
which the schema document is located. Further, the target namespace of the schema is 
another URL (different from the schema location URL) that specifies an "abstract" 
namespace within which the elements and types get declared. An instance document 
should specify both the namespace of the root element and the location (URL) of the 
schema that defines this element. 

For example consider the XML Schema shown below. It declares a complexType 
called "PurchaseOrderType" and an element "PurchaseOrder" of this type. 
<schema xmlns="http: / /www. w3 . org/2001/XMLSchema " 
targetNamespace= "http : / /www . oracle . com/ P0 . xsd" > 
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<complexType name = " Pur chaseOrder Type" > 
<attribute name = ■ PurchaseDate" type = ,! date B /> 
<sequence> 

<element name = "PONum" type = "decimal "/> 

<element name = "Company" type = "string" maxLength = "100" /> 
<element name = "Item" maxOccurs = "1000"> 
<complexType> 
<sequence> 

<element name = "Part" type = "string" maxLength = "1000"/> 
<element name = "Price" type = n float "/> 
</sequence> 
< / complexType> 
</element> 
</ sequenced 
</complexType> 

<element name=" Pur chaseOrder" type=" Pur chaseOrder Type" /> 
</schema> 

. .The following statement registers this schema at URL 
,, http://www.oracle.com/PO.xsd'\ (doc is a variable holding the above schema text). 
dbms_xml schema . regi st erSchema ( ' http : / /www . oracle . com/ PO . xsd 1 
, doc) ; 

As shall be described in greater detail hereafter, a registered XML Schema can be 
used to create schema-based XMLType tables and columns. The following is an 
XMLType instance that conforms to the above XML schema. The schemaLocation 
attribute specifies the schema URL, 

<PurchaseOrder xmlns="http: //www. oracle. com/ PO. xsd" 

xmlns : xsi= " ht tp : / /www . w3 . org/2001 /XMLSchema- 

instance" 

xsi : schemaI.ocation= n http : / /www. oracle . com/PO, xsd 
http: //www. oracle .com/PO. xsd" 

Pur chaseDa te= " 0 1 -JAN- 2 0 0 1 " > 
< P0Num> 1 0 0 1 < / P0Num> 
<Company>Oracle Corp</Company> 
<Item> 

<Part>9i Doc Set</Part> 
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<Frice>2550</Price> 
</Item> 

</PurchaseOrder> 

According to one embodiment of the invention, XML schema registration 
includes (1) schema validation, (2) determination of appropriate data structures, and (3) 
generation of mapping information. Each of these phases shall be described in greater 
detail hereafter. 

XML SCHEMA VALIDATION 
XML schemas describe the structure of a particular type of XML document. 
However, XML schemas are themselves XML documents that must conform to the 
structure specified in an XML schema. Specifically, each XML schema must conform to 
the structure described in the XML schema document associated with the XML schema 
document type. During the schema validation phase of XML schema registration, the 
XML schema that is being registered is inspected to verify that the XML schema 
conforms to the structure specified in the XML schema associated with the XML schema 
document type. 

DETERMINATION OF APPROPRIATE DATABASE REPRESENTATION 
As mentioned above, the appropriate database representation determination is a 
determination about how data that conforms to an XML schema should be managed by 
the database system. According to one embodiment, the appropriate database 
representation is selected to achieve a high correlation between (1) the structure imposed 
on data by the XML document in which the data is contained, and the (2) the structure 
imposed on the data by a database system. 

The ability to achieve a high correlation depends, at least in part, on the 
capabilities of the database system. The specific capabilities of database systems vary 
from vendor to vendor and version to version. While certain capabilities are common to 
most database systems, other capabilities are not. Thus, while embodiments of the 
present invention shall be described herein in the context of a database system with a 
specific set of capabilities, the invention is not limited to database systems that possess 
those specific capabilities. 
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According to one embodiment, the determination of the appropriate database 
representation is performed based on a set of general rules, governing the operation of 
XML schema mapper 106, about how to map each type of construct that may be 
encountered in an XML schema to a corresponding construct supported by the target 
object-relational database system. The rules may be hard-coded into the logic of XML 
schema mapper 106, or represented in metadata that is used by XML schema mapper 106. 
According to one embodiment, the general rules address the following issues: 

• How to map datatypes supported by XML to datatypes supported by the target 
object-relational database system; 

• How to map the structure defined by an XML schema to a database object with a 
similar structure; 

• How to map constraints supported by XML to constraint enforcing mechanisms 
supported by the target object-relational database system; 

• How to reflect, in the target object-relational database system, that the XML 
schema inherits from another XML schema; and 

• How to reflect, in the target object-relational database system, other constructs 
supported by XML, such as substitution groups, simple content, wildcards, 
external references via include and import elements, etc. 

MAPPING XML DATATYPES TO OBJECT-RELATIONAL DATATYPES 
An XML schema declares a set of primitive types. According to one embodiment, 
the rules used by the XML schema mapper 106 define the datatypes, supported by the 
target database system, to which each of the XML datatypes correspond. For example, in 
one embodiment, the XML datatype "string" maps to either of VARCHAR or CLOB 
SQL datatypes. In this example, the XML schema mapper 106 may choose whether to 
map a particular string element to a VCHAR or CLOB based, for example, on any length 
constraints that could be declared, for the string element, in the XML schema. Numerous 
examples of the datatype-to-datatype mapping rules that XML schema mapper 106 may 
use are presented hereafter, and described in Appendix L 

MAPPING XML STRUCTURE TO DATABASE OBJECTS 
SQL schemas describe the structure of an element in terms of the elements and 
attributes that can appear within it. The rules that map XML structure to database 
objects indicate how to map an SQL object type with attributes corresponding to the 
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XML attributes and elements defined within the XML schema. For example, an XML 
element A containing attribute X and elements Y and Z, will map to an object type with 
three attributes: X, Y and Z. 

MAPPING XML CONSTRAINTS TO DATABASE CONSTRAINTS 
XML schemas can specify various forms of constraints. Such constraints, when 
encountered by XML schema mapper 106, are mapped to the appropriate constraint 
mechanisms in SQL. For example, the length constraint for a "string" attribute defined in 
an XML schema may be maxLength="20". According to one embodiment, such a 
constraint would cause the string attribute to be mapped to the data type 
VARCHAR2(20). 

Another type of constraint that can be applied to XML elements is a constraint 
that specifies a maximum number of occurrences of the element. When the maximum 
number is greater than one, the element can be mapped to an array type supported by the 
target database system (e.g. VARRAY). The number of occurrences specified for the 
XML constraint dictates the cardinality of the VARRAY. 

Other types of constraints that may be specified for elements of an XML schema, 
and reflected in corresponding constraints in the appropriate database representation, 
include uniqueness constraints, referential integrity constraints, not null constraints, etc. 

MAPPING INHERITANCE 
The XML schema model allows for inheritance of complex types. According to 
one embodiment, when an XML schema makes use of the inheritance construct, the 
inheritance is mapped to the SQL object inheritance mechanisms supported by the target 
database system. For example, within an XML schema, an XML complexType 
"USAddress" can be declared as an extention of another complexType "Address". In 
response, within the appropriate database representation, an SQL object type 
"USAddress" is declared as a subtype of the SQL object type that corresponds to 
"Address". 

LOCAL AND GLOBAL SCHEMAS 
By default, an XML schema belongs to the user performing the registration. A 
reference to the XML schema document is stored within the XDB hierarchy within the 
directory /sys/schemas/<usemame>/.... For example, if the user SCOTT registered the 
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above schema, it gets mapped to the file 
/sys/schemas/SCOTT/www.oracle.com/PO.xsd 

Such schemas are referred to as local schemas. In general, they are usable only by the 
user to whom it belongs. Note that there is no notion of qualifying the schema URL with 
a database user name, because the schema location appearing in instance XML 
documents are simply URLs. Thus, only the owner of the schema can use it in defining 
XMLType tables, columns or views, validating documents, etc. 

In contrast to local schemas, privileged users can register a XML schema as a 
global schema - by specifying an argument to dbms_xmlschema registration function. 
Global schemas are visible to all users and are stored under /sys/schemas/PUBLIC/.... 
directory within the XDB hierarchy. Note that the access to this directory is controlled by 
ACLs - and by default, is write-able only by DBA. A user needs to have write privileges 
on this directory to be able to register global schemas. 

A user can register a local schema with the same URL as an existing global 
schema. A local schema always hides any global schema with the same name(URL). 

A user can register a link to an existing schema - potentially owned by some other 
user. The schema link is identified by its URL. The schema link URL can then be used 
wherever a schema URL is expected, e.g. creating a xmltype table. The reference to the 
schema link gets translated to the underlying schema at the time of reference. 
If a user has a local schema with the same name as a global schema, there is a mechanism 
that allows the user to explicitly reference the global schema. The user can register a link 
(with a different name) to the global schema. 

DELETING XML SCHEMAS 
According to one embodiment, an XML Schema can be deleted by using the 
dbms_xmlschema.deleteSchema procedure. When a user tries to delete a schema, the 
database server first checks for its dependents. If there are any dependents, the database 
server raises an error and the deletion operation fails. A FORCE option is provided while 
deleting schemas - if the user specifies the FORCE option, the schema deletion will 
proceed even though it fails the dependency check. In this mode, schema deletion will 
mark all its dependents as invalid. 
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DEPENDENCY MODEL FOR XML SCHEMAS 
According to one embodiment, the following objects "depend" on a registered 
XML schema: 

• Tables/Views that have a XMLType column that conforms to some element in 
this schema. 

• XML schemas that include or import this schema as part of their definition 

• Cursors that reference the schema name for eg. within XMLGEN operators. 
(Note:These are purely transient objects) 

The following operations result in dependencies being added on a XML schema 

object : 

• Schema registration : Add dependencies on all included/imported schemas 
Table/View/Cursor creation : Add dependency from table/view/cursor on the 
referenced xml schema object. 

TRANS ACTIONAL BEHAVIOR 
According to one embodiment, the registration of a schema is non-transactional 
and auto-committed similar to other SQL DDL operations. If the registration is 
successful, the operation is auto-committed. However, if the registration fails, the 
database is rolled back to the state before the registration began. Since the schema 
registration process potentially involve creating object types and tables, the error recovery 
involves dropping any such created tables and types. Thus, the entire schema registration 
is guaranteed to be atomic i.e. it either succeeds or else the database is restored to the 
state before the start of registration. 

XML SCHEMA EVOLUTION 
A user may evolve a registered XML schema by re-registering it and providing 
the new XML schema document. The dbms_xmlschema.registerSchema function can be 
used to re-register the XML schema. This operation always succeeds if there are no 
XMLType tables that depend on this schema (XMLType views are okay). According to 
one embodiment, if there are any dependent XMLType tables, database server 104 
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requires that the input schema document contain the complete SQL mapping annotations - 
and that they represent a valid mapping applicable to all such XMLType tables. 

Example - Changing the names of elements or attributes: The user retrieves the 
registered schema document, makes the needed modifications and re-registers it. Note 
that this alteration does not affect the underlying tables. 

Example - Adding a new element or attribute: Since this alteration affects 
underlying tables, it has to be performed in multiple steps. The user first uses the ALTER 
TYPE and/or ALTER TABLE commands to evolve the underlying tables. This marks the 
XML schema as invalid. The user then modifies the XML schema document as 
appropriate and re-registers it. 

According to one embodiment, a 1-step XML schema evolution is provided, i.e. a 
user simply inputs a new XML schema and all underlying type and table alterations are 
determined implicitly. 

IMPLICIT REGISTRATION OF XML SCHEMAS 
When instance documents are inserted into XDB via protocols such as HTTP or 
FTP, the schemas to which they conform (if specified) are registered implicitly - if not 
already registered. Since the schema registration is always auto-committed, the implicit 
registration is performed within an autonomous transaction. 

XMLTYPE TABLES 
Tables and columns that are part of the "appropriate database representation" of 
an XML schema are referred to herein as "schema-based" tables and columns. According 
to one embodiment, Schema-based XMLType tables and columns can be created by 
referencing the schema URL (of a registered schema) and the name of the root element. A 
subset of the XPointer notation (shown below) can also be used in providing a single 
URL containing both the schema location and the element name. 

CREATE TABLE po_tab OF xmltype 
XMLSCHEMA "http: //www. oracle. com/ PO.xsd" ELEMENT 
0 PurchaseOrder " 

An equivalent definition is 

CREATE TABLE po_tab of xmltype 

element " ht tp : / /www . oracle . com/ PO . xsd# PurchaseOrder " ; 
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By default, schema-based XMLType is stored in an underlying (hidden) object 
type column. The SQL object types can be created (optionally) during the schema 
registration process. The mapping from XML to SQL object types and attributes is itself 
stored within the XML schema document as extra annotations i.e. new attributes defined 
by XDB. 

Schema-based XMLType can also be stored in a single underlying LOB column. 
CREATE TABLE po_tab OF xmltype 
STORE AS CLOB 

ELEMENT "http: //www. oracle. com/ PO.xsd#PurchaseOrder n ; 

Creation of SQL object types 
According to one embodiment, when an XML schema is registered, database 
server 104 creates the appropriate SQL object types that enable a structured storage of 
XML documents conforming to this schema. All SQL object types are created in the 
current user's schema (by default). For example, when PO.xsd is registered, the following 

SQL types are created. 

create type Item_t as object 
( 

part varchar2<1000) , 
price number 

); 

create type ltem_varray_t as varray(lOOO) of OBJ_Tl; 

create type PurchaseOrder_t as object 

( 

purchasedate date, 
ponum number, 
company varchar2 ( 100) , 
item Item_varray_t 

>; 

The names of the object types and attributes above may actually be system- 
generated. If the schema already contains the SQLName attribute filled in, this name is 
used as the object attribute's name. Else, the name is derived from the XML name - unless 
it cannot be used because of length, or conflict reasons. If the SQLSchema attribute is 
filled in, Oracle will attempt to create the type in the specified schema. The current user 
must have any necessary privileges to perform this operation. 
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MAPPING XML SCHEMAS TO OBJECT TYPES - A DETAILED EXAMPLE 
The following sections provide the details on how the SQL object types may be 
generated from the XML schema information. As was mentioned above, the actual 
mapping rules may vary from implementation to implementation based on a variety of 
factors. One such factor is the capabilities of the target database system. In the following 
detailed example, it is assumed that the target database system supports the data types and 
object typing mechanisms currently available in the Oracle 9iR2, currently available from 
Oracle Corporation. 

MAPPING SIMPLE TYPES 
According to one embodiment, an XML primitive type is mapped to the closest 
SQL datatype. For example, decimal, positive Integer and float are all mapped to SQL 
NUMBER. An XML enumeration type is mapped to an object type with a single 
RAW(n) attribute - the value of n is determined by the number of possible values in the 
enumeration declaration. An XML list or union datatype is mapped to a string 
(VARCHAR2/CLOB) datatype in SQL. 



Default mapping of XML simple types to SOL 



XML simple 
type 


Length/ 
Precision 


MaxLength 
/Scale 


Default Oracle 
datatype 


Compatible 
datatypes 


Comments 


string 




n (n < 4000) 


VARCHAR2(n) 


NVARCHAR2, 
CHAR, CLOB, 
NCHAR, 
NCLOB 


n < 2000 for UTF-] 
encoding 


string 


m (m < 
4000) 




CHAR(n) 


VARCHAR2, 

NVARCHAR2, 

CLOB, 

NCHAR, 

NCLOB 


n< 2000 for UTF-] 
encoding 


string 


m (m > 
4000) 




CLOB 


VARCHAR2, 

NVARCHAR2, 

CHAR, 


n> 2000 for UTF-1 
encoding 
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NCHAR, 
NCLOB 




string 




n (n > 4000) 


CLOB 


VARCHAR2, 
NVARCHAR2, , 
CHAR, 
NCHAR, 
NCLOB 

i 


n> 2000 for UTF-1 
encoding 


boolean 






RAW(l) 


! 
t 

i 


Values MUST be 0 
1. 


float 






FLOAT 


NUMBER, 
DOUBLE 




double 






DOUBLE 


NUMBER ! 

i 




decimal 


precision 
m 


scale n 


NUMBER(m,n); 


i 

: 


If m & n == 0, then 
map to NUMBER 


timelnstant 






TIMESTAMP 

i 


TIME?? 


Timstamp in XML 
can map to the form 
CCYY-MM-DDThl 
mm-ss.sss 


timeDuration 






i 

i 

INTERVAL 


TIMESTAMP?? 


XML duration 
supports 

PnYnMnDTnHnMr 
format from ISO 
8601. 


recurringDuration 






INTERVAL 






binary 


m (m < 
4K) 


OR n, n<4K 


RAW(m) or 
RAW(n) 


BLOB 




hinarv 

VlllCLL y 


m (m > 
4K) 


ORn n>4K 


BLOB 


RAW 


length or maxlength 
4K 


uri 






UriType 
(VARCHAR2) 


NVARCHAR2, 

CLOB, 

NCHAR, 


Length or uri must 1 
less than 4K 
Or2KforUTF-16.. 
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CHAR, 
NCLOB 



Default XML D atatype Mappi ng to SOL (for sim ple Types) fCONTD) 



YA/ffT 
AiVtJU 

simpleType 


Onfall It Oira^lo 

Type 


Types 


Comments 

i 


Language (string) 


VARCHAR2(4000) 


N V AKL.rLA.K2, 
CLOB,CHAR, 
NCLOB, NCHAR 


2000 for UTF-16 (for all) 


NMTOKEN (string) 


VARCHAR2(4000) 


— same — 


if tt | 


NMTOKENS 
(string) 


VARCHAR2(4000) 


- same -- 


it H 


Name (string) 


VARCHAR2(4000) 


— same — 


A generic XML Name 


NCName (string) 


VARCHAR2(4000) 


« same — 


Represents an non- 
colon'ized name 


ID 


VARCHAR2(4000) 


- same — 


Unique throughout the 
document 


IDREF 


VARCHAR2(4000) 


- same — 


Must match an ID in the 1 
document i 


IDREFs 


VARCHAR2(4000) 


- same — 




ENTITY 


VARCHAR2(4000) 


~ same — 




ENTITIES 


VARCHAR2(4000) 


- same — 




NOTATION 


VARCHAR2(4000) 


- same — 




QName 


XDB.XDBSQNAME 




Represents a qualified 
XML name. Stored an an 
object type with two 
attributes - the 
unqualified name string 
and the index number of 
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the namespace into the 
global namespace array. 


integer 


INTEGER 


INT, NUMBER 




nonNegativelnteger 


INTEGER 


INT, NUMBER 




positivelnteger 


INTEGER 


TX TT X TT TTk jtT* 1"' 1 > 

INT, NUMBER 




nonPosi ti vein teger 


INTEUbK 


IMT 1 XTT TX /TT5 FT) 

INI, IMUMBbK 




negativelnteger 


INTEGER 


INT, NUMBER 




date 


DATE 


TIMESTAMP 




time 


TIMESTAMP 


DATE 





MAPPING COMPLEX TYPES 

According to one embodiment, a complextype is mapped to an object type. XML 
attributes declared within the complexType map to object attributes - the simpleType 
defining the XML attribute determines the SQL datatype of the corresponding attribute. 
XML elements declared within the complexType are also mapped to object attributes. 
The datatype of the object attribute is determined by the simpleType or complexType 
defining the XML element. 

If the XML element is declared with maxOccurs attribute's value > 1 , it is mapped 
to a collection attribute in SQL. The collection could be either a VARRAY (default) or 
nested table (if the maintainOrder attribute is set to FALSE). Further, the default storage 
of the VARRAY is in tables (OCTs) [OCT-FS] instead of LOBs - the user can choose the 
LOB storage by setting the storeAsLob attribute to TRUE. 

In general, the name of the SQL attribute is generated from the XML element or 
attribute name using the following algorithm : 

1. use XML element/attribute name (truncated to 30 chars) 

2. if an illegal SQL character is found, map it to underscore ('_') 

3. if this name is not unique, append a sequence number (note: this may 
require further truncating the name before appending the number) 
However, the user can explicitly specify the SQL attribute name by providing a 
value for the SQLName attribute within the schema 
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DOM FIDELITY 

All elements and attributes declared within the XML schema get mapped to 
separate attributes within the corresponding SQL object type. However, there are some 
pieces of information in the XML instance documents that are not represented directly by 
such element/attributes. Examples are : 

• Comments 

• Namespace declaration 

• Prefix information 

In order to guarantee that the returned XML documents are identical to the 
original document for purposes of DOM traversals (referred to as DOM fidelity), a binary 
attribute called SYS_XDBPD$ is added to all generated SQL object types. This attribute 
stores all pieces of information that cannot be stored in any of the other attributes - 
thereby ensuring DOM fidelity of XML documents stored in the database system. 
Note : The SYS_XDBPD$ attribute is omitted in many examples for reasons of clarity. 
However, the attribute is may be present in all SQL object types generated by the schema 
registration process. 

SQL OUT OF LINE STORAGE 
According to one embodiment, by default, a sub-element is mapped to an 
embedded object attribute. However, there may be scenarios where an out-of-line storage 
offers better performance. In such cases the SQLInline attribute can be set to FALSE - 
and the XML schema mapper 106 generates an object type with an embedded REF 
attribute. The REF points at another instance of XMLType that corresponds to the XML 
fragment that gets stored out-of-line. Default tables (of XMLType) are also created to 
store the out-of-line fragments. 
Example 

<complexType name = " Employee" > -- 0BJJT2 
<sequence> 

< element name = "Name" type = "string" maxLength = "1000" /> 
<element name = "Age" type = "decimal "/> 
<element name « "Addr" SQLInline = "false n > . 
<complexType> OBJ_Tl 
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<sequence> 

<element name = "Street" type = "string" maxLength = 

"100"/> 

<element name = "City" type = "string" maxLength = 

"100"/> 

</sequence> 
< / compl exType> 
</element> 
</sequence> 
< / complexType> 

create type OBJJT1 as object 
( 

Street varchar2 ( 100) , 
City varchar2 (100) 

) ; 

create type OBJJT2 as object 
( 

Name varchar2 (100) , 
Age number, 
Addr REF XMLType 

) ; 

MAPPING XML FRAGMENTS TO LOBS 
A user can specify the SQLType for a complex element as LOB(CLOB/BLOB) in 
which case, the entire XML fragment gets stored in a LOB attribute. This is useful in 
scenarios where some portions of the XML document are seldom queried upon, but are 
mostly retrieved and stored as a single piece. By storing the fragment as a LOB, the 
parsing/decomposition/recomposition overhead is reduced. 
Exampl e 

<complexType name = " Employee "> 0BJ_T 
<sequence> 

<element name = "Name" type = "string" maxLength = "1000" /> 
<element name = "Age" type = "decimal" /> 
<element name = "Addr" SQLType = n CLOB n > 
<complexType> 
<sequence> 

<element name = "Street" type = "string" maxLength = 

"100"/> 
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<element name = "City" type = "string" maxLength = 

"100 n /> 

</sequence> 
</complexType> 
</element> 
</sequence> 
</complexType> 
create type OBJ_T as object 
( 

Name varchar2 (100) , 
Age number, 
Addr CLOB 

>; 

MAPPING SIMPLE CONTENT 
A complexType based on a simpleContent declaration is mapped to an object type 
with attributes that correspond to the XML attributes and an extra S YS_XDBBODY$ 
attribute corresponding to the body value. The datatype of the body attribute is based on 
the simpleType which defines the body's type. 
Exampl e 

<complexType> 
< s impleCont ent > 

restriction base = "string" maxLength ■= "1000"> 

<attribute name = "al" type = "string" maxLength = "100"/> 
</restriction> 
</simpleContent> 
</ complexType 

create type OBJ_T as object 
( 

al varchar2 (100) , 
SYS_XDBBODY$ varchar2 ( 1000 ) 

) ; 

MAPPING ANY/ANY ATTRIBUTE 
any element declarations and anyAttribute attribute declarations are mapped to 
LOBs in the object type. The LOB stores the text of the XML fragment that matches the 
any declaration. The namespace attribute can be used to restrict the contents to belong to 
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a specified namespace. The processContents attribute within the any element declaration 
indicates the level of validation required for the contents matching the any declaration. 
Example 

<complexType name = " Employee "> 
<sequence> 

<element name = "Name" type = "string" maxLength = "1000" /> 
<element name = "Age" type = "decimal" /> 
<any namespace = "http: //www/w3 .org/ 2001 /xhtml " 
processContents = n skip n /> 

</sequence> 
</complexType> 
create type OBJJT as object 
( 

Name varchar2 (100) , 
Age number, 
SYS_XDBANY$ blob 

) ; 



MAPPING STRINGS TO SQL VARCHAR2 VS CLOB 
If the XML schema specifies the datatype to be "string" and a maxLength value of 
less than 4000, it gets mapped to a varchar2 attribute of the specified length. However, if 
the maxLength value is not specified in the XML schema, it can only be mapped to a 
LOB. This is sub-optimal in cases when the majority of string values are actually small - 
and a very small fraction of them is large enough to necessitate a LOB. The ideal SQL 
datatype would be varchar2(*) that would perform like varchars for small strings but can 
accommodate larger strings as well. Further, such columns should support all varchar 
functionality such as indexing, SQL functions, etc. A similar case can be made for 
needing a raw(*) datatype to hold unbounded binary values without loss of performance^ 
and/or functionality for the small cases. 

According to an alternative embodiment, all unbounded strings are mapped to 
CLOBs and all unbounded binary elements/attributes are mapped to BLOBs, 

MAPPING STRINGS TO SQL VARCHAR2 VS NVARCHAR2 
By default, the XML string datatype is mapped to SQL varchar2. However, the 
user can override this behavior in a couple of ways : 
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L The user can specify SQLType to be NVARCHAR2 for a particular string 
element or attribute. This ensures that NVARCHAR2 is chosen as the SQL type 
for the particular element/attribute. 

2. The user can set the mapStringToNCHAR attribute to "true" at the top of the 
schema declaration. This ensures that all XML strings get mapped to 
NVARCHAR2 (or NCLOB) datatype, unless explicitly overridden at the element 
level. 

CREATING SCHEMA-BASED XML TABLES 
Assuming that the XML schema identified by "http://www.oracle.com/PO.xsd M 
has already been registered. A XMLType table can be created to store instances 
conforming to the PurchaseOrder element of this schema - in an object-relational format - 
as follows : 

create table MyPOs of xmltype 

element "http: //www. oracle. com/ PO.xsd#PurchaseOder" ; 

Hidden columns are created corresponding to the object type to which the 
PurchaseOrder element has been mapped. In addition, a XMLExtra object column is 
created to store the top-level instance data such as namespaces declarations, etc. 
Note : XMLDATA is a pseudo-attribute of XMLType that allows directly accessing the 
underlying object column. 

SPECIFYING STORAGE CLAUSES 
The underlying columns can be referenced in the storage clauses by 

L object notation : XMLDATA.<attrl>.<attr2>.... 

2. XML notation : Extract Value(xmltypecol, Vattrl/attr2') 
create table MyPOs of xmltype 

element "http: //www. oracle . com/PO .xsd#PurchaseOrder" 
lob (xmldata.lobattr) store as (tablespace ...); 
create table MyPOs of xmltype 

element "http: //www. oracle .com/PO. xsd#Purchase0rder tt 

lob ( ExtractValue (MyPOs , '/lobattr')) store as (tablespace ...); 
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CREATING INDEXES 
As shown above, columns underlying a XMLType column can be referenced 
using either a object notation or a XML notation in the CREATE INDEX statements, 
create index ponum_idx on MyPOs (xml data, ponum) ; 
create index ponum_idx on MyPOs p (ExtractValue <p, 
■ /ponum 1 ) ; 

CONSTRAINTS 

Constraints can be specified for underlying columns by using either the object or 

the XML notation. 

create table MyPOs of xmltype 

element "http : / /www . oracle . com/PO . xsd#PurchaseOrder " 
(unique (xmldata.ponum) ) ; 
create table MyPOs p of xmltype 
element 

"http: //www. oracle. com/PO.xsd#PurchaseOrder" {unique ( Extract V 
alue(p , • /ponum' )); 

DMLS 

New instances can be inserted into a XMLType table as : 

insert into MyPOs values 

( xml type. cr eat exml ( ' <PurchaseOrder> </PurchaseOrder> ' ) ) ; 

The XMLType table can be queried using the XPath-based SQL operators. 

select value (p) from MyPOs where extractvalue (value (p) , 
'/Company) = 'Oracle'; 

The query rewrite mechanism rewrites queries involving existsNode and extract 
operators to directly access the underlying attribute columns - thereby avoiding 
construction of the XML followed by subsequent XPath evaluation. For example, the 

above query gets rewritten to : 

select value (p) from MyPOs where p. xml data .company = 
• Oracle 
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QUERY REWRITE 
XPath based operators (Extract, ExistNode,Extract Value) operating on schema- 
based XMLType columns are rewritten to go against the underlying SQL columns. This 
enables further SQL optimizations that fully exploit the object-relational storage of the 
XML. The following kinds of XPath expressions can be translated into the underlying 
SQL queries : 

1. Simple XPath expressions - involving traversals over object type attributes 
only, where the attributes are simple scalars or object types themselves. The only axes 
supported are the child and the attribute axes. 

2. Collection traversal expressions - involve traversal of collection expressions. 
Only axes supported are child and attribute axes. 

3. Expressions involving * axes - Transform those expressions involving the 
wildcard axes provided the datatypes of the resulting nodes are all coercible, (e.g. 
CUST/*/CUSTNAME must point to CUSTNAMEs which are all of the same or coercible 
datatypes). 

4. Expressions involving descendant axis (//) - Transform these expressions 
provided the datatypes of the resulting nodes are the same or coercible. 

5. All of these expressions must work with the type cache, which includes 
"hidden" traversals like REFs to XMLTypes etc.. (for instance xdb$schema_t stores a 
varray of REFs to xdb$element_t and this is not directly apparent in the XPath expression 
or the resulting XML document). 

Transformations of these XPath expressions are supported in the ExistsNode, 
ExtractValue and Extract usage scenarios. 

Examples of query rewrite of XPath. 

Original Query 

select * from MyPOs p 

where ExistsNode (p, ?/PO[PNAME=?P01?] PONO?) = 1 
After Rewrite of ExistsNode 

select * from MyPOs p 

where (CASE WHEN (p .xmldata.pono IS NOT NULL) 

AND (p.xmldata.PNAME a ?P01?)) THEN 1 ELSE 0 ) = 

1 

Original Statement 

select ExtractValue (p, ? / [ PNAME= ? POl * ] / PONO ? ) from MyPOs p 
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After Rewrite of Extract 

select (select p.xmldata .pono from dual where 
p.xmldata.pname = ?P01?) 
from MyPOs ; 

FUNCTION REWRITE RULES 
EXTRACT, EXTRACTVALUE and EXISTSNODE can appear in the following 
positions 

• In the select list, where clause predicate, group by and order by expressions in a 
SQL query. 

• In the Index clause of a CREATE INDEX statement. 

create index foo_index on foo_tab (extractvalue {xml_col, 
' /PO/PONO' ) ) ; 

In all these cases, the EXISTSNODE and EXTRACT operator get replaced by 
their definining underlying expressions. The XPath expressions must satisfy the 
conditions listed in the previous section for them to be rewritten. 

In the index case, if replacing the whole operator tree results in a single column, 
then the index is turned into a BTree or a domain index on the column, rather than being a 
functional index. 

REWRITE FOR OBJECT/SCALAR ATTRIBUTE TRAVERSALS 
Simple XPath traversal are rewritten into object type accessors. Predicates are 
handled by putting them in the where clause. Any XPath child access over an object type 
is translated to an object attribute access on the underlying object type. For example A/B 
maps to a.b where A maps to the object type a and the XPath node B maps to the attribute 
of "a" named "b". 

This rewrite is consistent at any level of the XPath expression, i.e. whether the 
XPath traversal occurs within a predicate, or a location path variable. 
For example, 

PO/CUSTOMERyCUSTOMERNAME becomes "po"."cust"."custname" (assuming PO 
maps to "po" etc..) 
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Predicates are handled by rewriting the predicate expression in the underlying object 
expressions. 

In the simple case, for EXISTSNODE, the main location path traversal becomes a 
IS NOT NULL predicate, whereas for the EXTRACT case, this becomes the actual node 
being extracted. 

EXISTSNODE(po_col, 'PO/CUSTOMER/CUSTOMERNAME') 
becomes 

CASE (WHEN ( "poVcust'V'custname" IS NOT NULL) then 1 ejse 0) 

Predicates are handled in a similar manner.For example, in the operator given 

below, 

EXISTSNODE(po_col, TO/CUSTOMER[CUSTOMERNO=20]/CUSTOMERNAME') 

the predicate, D = 20 is treated as if the user specified, (A/B/D = 20) 

Thus the whole expression becomes, 

CASE (WHEN ( "PO'V'CUST'V'CUSTNAME" IS NOT NULL 
AND ("PO M ."CUST M ."CUSTNO" = 20)) THEN 1 ELSE 0) 

COLLECTION TRAVERS ALS 

The XPath expressions may also span collection constructs and the queries are 
still rewritten by using subqueries on the collection tables. For example, 

EXISTSNODE(po_col, 7PO/lineitems[lineitemno=20]') is checking for the 
existance of lineitems in a purchase order where the lineitem number is 20. This 
becomes, 

case(when ( exists(select * from TABLEO'po'V'lineitems") where lineitemno = 
20)) then 1 else 0) 

DEFAULT TABLES 
As part of schema registration, default tables can also be created. The default table 
is most useful in cases when XML instance documents conforming to this schema are 
inserted through APIs that do not have any table specification e.g. FTP, HTTP. In such 
case, the XML instance is inserted into the default table. 
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If the user has given a value for defaultTable attribute, the XMLType table is 
created with that name. Else, it gets created with some internally generated name. Further, 
any text specified as the tableStorage attribute is appended to the generated CREATE 
TABLE statement. 

SPECIFYING THE INTERNAL MEMORY DATATYPE 
The XML data is stored in a C structure within RDBMS memory. In general, the 
in-memory representation of the XML data is such that it tries to avoid datatype 
conversions at load time, and converts data only when accessed, since many parts of the 
document may not be accessed at all. As part of schema registration, the in-memory 
datatype is chosen based on the XML datatype - and this information is stored within the 
schema document using the memDatatype attribute. However, there are some scenarios in 
which an application may wish to override the default memory type in favor of a different 
in-memory representation. 

Eg. the default memory representation of strings is "char" which keeps the string 
data in the database session character set. However, if this data is only consumed by a 
Java application that requires it in Fixed Width UCS-2 Unicode, it may be more 
performant to set the memDatatype to "JavaString". This ensures that database server 104 
keeps the data directly in Java memory in Unicode format - thereby avoiding any format 
conversions or copies. 



XML 
Datatype 


Allowed 
Memory 
Datatypes 


Description 


Default 


String 


Char 


Varying width character data in character set 
currently active for this session. 


Yes 




JavaString 


Fixed width UCS-2 Unicode allocated from JServer 
memory. 


No 


Integer 


integer 


Signed 8 byte native integer by default; if XML 
schema specifies max & min values, a smaller or 
unsigned datatype may be used 


Yes 
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number 


Oracle number format 


No 


float 


Float 


Native maximum precision floating point; smaller 
value may be used if max & min are specified 
within range of smaller type 


Yes 




number 


Oracle number format 


No 



GENERATION OF MAPPING INFORMATION 
Once the appropriate database representation has been determined for a particular 
XML schema, mapping information is generated to indicate the correlation between the 
elements of the appropriate database representation and the elements identified in the 
particular XML schema. For example, if the appropriate database representation for an 
XML schema for type "person" includes a table PERSON for storing the data items 
contained in person XML documents, then the mapping information would indicate a 
correlation between person XML documents and table PERSON. 

In addition to the general correlation between an XML schema and a database 
schema object (such as a table), the mapping information may reflect correlations at much 
finer levels of granularity. For example, the mapping information may indicate which 
specific column of the PERSON table should be used to store each specific data item 
within person XML documents. 

According to one embodiment, the information regarding the SQL mapping is 
itself stored within the XML schema document. During the registration process, the XML 
schema mapper 106 generates the SQL types (as shown above). In addition it adds 
annotations to the XML schema document to store the mapping information. Annotations 
are in form of new attributes. Example : The schema below shows the SQL mapping 
information captured via SQLType and SQLName attributes. 
<schema xmlns="http: / /www.w3 . org/ 2001 /XMLSchema" 
targetNamespace="http : //www. oracle , com/PO. xsd" > 
<complexType name = "PurchaseOrder"> 
■ <at tribute name = "PurchaseDate" type = "date" SQLName = ■ PURCHASEDATE " 
S QLType = n DATE n /> 
<sequence> 

<element name = "PONum" type = "decimal" S QLName = " PONUM " 
S QLType = " NUMBER " / > 
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< element name = "Company" ' type = "string" maxLength = "100" 
S QLName = " COMPANY n SQLType ="VARCHAR2 D / > 

<element name = "Item" maxOccurs = "1000" S QLName = " ITEM " 
SQLType= n ITEM_T n S QLCo 1 lType = " ITEM_VARRAY_T n > 

<complexType> 
<sequence> 

<element name = "Part" type = "string" maxLength = "1000" 
S QLName = n PART" S QLTyp e = " VARCHAR2 " / > 

<element name = "Price" type = "float" SQLName=" PRICE" 
SQLType= n NUMBER n / > 

</sequence> 
</complexType> 
</element> 
</sequence> 
</complexType> 

<element name="PO" type=" PurchaseOrder" SQLType=" PURCHASED RDER_T" /> 
</ schema > 

USER-SPECIFIED NAMES IN INPUT SCHEMA DOCUMENT 
The user can specify the names of the SQL object types and its attributes by filling 
in the SQLName and SQLType attributes prior to registering the schema. If the 
SQLName and SQLType values are specified by the user, then the XML schema mapper 
106 creates the SQL object types using these names. If these attributes are not specified 
by the user, an internal name-generation algorithm is used to generate the names. See 
Appendix for details on the name generation algorithm. 

The table below lists all the annotations used within the schema to capture the 
SQL mapping information. Note that the user need not specify values for any of these 
attributes. The XML schema mapper 106 will fill in the appropriate values during the 
schema registration process. However, it is recommended that user specify the names of 
at least the top level SQL types - in order to be able to reference them later. All 
annotations are in form of attributes that can be specified within attribute and element 
declarations. These attributes belong to the XDB namespace : 
http://xmlns.oracle.com/xdb/XDBSchema.xsd 



Table 1 : XDB attributes specifiable within element and attribute declarations 


Attribute 


Values 


Default 


Description 
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SQLName 


Any SQL 
identifier 


element 
name 


This attribute specifies the name of the 
attribute within the SQL object that 
maps to this XML element. 


SQLType 


Any SQL 
type name 


Name 

generated 

from 

element 

name 


This property specifies the name of the 
SQL Type corresponding to this XML 
element or attribute. This could refer to 
a scalar or object type depending on the 
XML schema declaration. 


SQLCollType 


Any SQL 
Collection 
type name 


Name. 

generated 

from 

element 

name 


This specifies the name of the SQL 
collection type corresponding to this 
XML element that has maxOccurs > 1. 


SQLSchema 


Any SQL 
user name 


User 

registering 

XML 

schema 


Name of database user owning the type 
specified by SQLType 


SQLCollSchema 


Any SQL 
user name 


User 

registering 

XML 

schema 


Name of database user owning the type 
specified by SQLCollType. 


maintainOrder 


true | false 


True 


If "true", the collection is mapped to a 
VARRAY. Else, the collection is 
mapped to a NESTED TABLE. 


store VarrayAsLob 


true | false 


True 


If "true", the VARRAY is stored in a 
LOB. If "false", the varray is stored as a 
table (OCT). 


SQLInline 


true | false 


true 


If "true" this element is stored inline as 
an embedded attribute (or a collection if 
maxOccurs > 1). If "false", a REF (or 
collection of REFs if maxOccurs > 1) is 
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\ 
t 

i 

i 


jtored. This attribute will be forced to 
■false" in certain situations (like cyclic 
•eferences) where SQL will not support 
nlining. 


maintainDOM 


true | false 


true 


[f "true", instances of this element are 
stored such that they retain DOM 
fidelity on output. This implies that all 
comments, processing instructions, \ 
namespace declarations, etc are retained 
in addition to the ordering of elements. 
If "false", the output need not be 
guaranteed to have the same DOM 
behavior as the input. j 


tableStorage 


any valid 
storage 
clause text 


NULL 


This attribute specifies the storage ; 
clause that is appended to the default 
table creation statement. It is 
meaningful mainly for elements that get; 
mapped to tables viz. top-level element j 
declarations and out-of-line element 
declarations. 


defaultTable 


Any table 
name 


Based on 

element 

name. 


This attribute specifies the name of the 
table into which XML instances of this 

schema should be stored. This is most ■ 

i 

useful in cases when the XML is being 
inserted from APIs where table name is 
not specified e.g. FTP, HTTP. 




Any URL 
pointing to 
a ACL 
document 


NULL 


This attribute specifies the URL of the 
ACL that should be applied by default 
to all instances of this element [Folder- 
FS]. 


isFolder 


true | false 


false 


If true, instances of this element can be 
used as a folder (or container) within 
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XDB [Folder-FS]. 


mapStringToNCHAR 


true j false 


false . 


If "true", all XML strings get mapped to 
NVARCHAR2 (or NCLOB) datatype, 
unless explicitly overridden at the 
element level. If "false", all XML string 
elements/attributes are mapped to 
varchar2 columns. 


memDatatype 


in-memory 
datatype 


internal 


This attribute can be used to override 
the default in-memory mapping of 
(simple) elements and attributes. See 
below for the table of allowed memory 
datatypes for a given XML datatype. 



HYBRID STORAGE MODELS 
According to one embodiment, the XML schema mapper 106 is implemented to 
support hybrid storage models in which the structure of some elements defined within the 
XML schema is maintained in the appropriate database representation, and the structure 
of other elements is not. For example, the most-often queried/updated portions of an 
XML document type may be mapped to object type attributes, while the rest of the 
portions of the XML document are stored together in a CLOB. According to one 
embodiment, the specific portions for with structure is to be maintained or not to be 
maintained are designated by pre-annotating the XML schema with appropriate mapping 
directives. 

TRANSACTIONAL NATURE OF XML SCHEMA REGISTRATION 
According to one embodiment, the XML schema registration is performed using 
the transaction support of database server 104 in a manner that allows executing 
compensating action to undo partial effects when errors are encountered during the 
schema registration operation. 

HANDLING CYCLIC DEFINITIONS IN XML SCHEMAS 
It is possible for XML schemas to include cycles. According to one embodiment, 
XML schema mapper 106 is configured to detect such cycles and break them by using 



33 



WO 03/030031 



PCT/US02/30783 



REFs while mapping to SQL object types, A detailed description of how REFs may be 
used to break cycles is provided in Appendix L 

STORING XML DOCUMENTS BASED ON THE MAPPING INFORMATION 

After an XML schema for a particular document type has been registered with 
database server 104, XML documents that conform with the schema can be intelligently 
managed by database server 104. According to one embodiment, when a protocol 
indicates that a resource must be stored in a database managed by database server 104, 
database server 104 checks the document's file name extension for .xml, .xsl, .xsd, and so 
on. If the document is XML, a pre-parse step is performed, where enough of the resource 
is read to determine the XML schemaLocation and namespace of the root element in the 
document. This location is used to look for a registered schema with that 
schemaLocation URL. If a registered schema is located with a definition for the root 
element of the current document, then the default table specified for that element is used 
to store that resource's contents. 

According to one embodiment, when an XML document is stored in a database 
server that supports the XML schema registration techniques described herein, the 
database server is able to validate the documents to verify that they confirm to the 
corresponding XML schema. The validation may include validation of both the structure 
and the datatypes used by the XML document. 

Various other benefits are achieved through the use of the techniques described 
herein. For example, the schema registration process allows the database server to 
enforce the integrity constraints and other forms of constraints on the XML documents 
and the tables used to store them. In addition, the database server is able to create indexes 
on and partition XML tables based on XML data. 

Because the structure of the XML documents is reflected in how the data from the 
XML documents are stored within the database, the tag information typically used to 
reflect the structure does not need to be stored along with the data. The ability to avoid 
storing some or all of the XML tags can result in a significant decrease in storage 
overhead, since the XML tags often form a large portion of the size of XML documents. 

Other performance benefits are also made possible. For example, query 
performance may be improved by rewriting XPath queries to directly access the 
underlying columns. In addition, update performance may be improved by rewriting 
updates to directly update the underlying columns. Consequently, updating a portion of 
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the XML data from a stored document would not always require the rewriting the entire 
XML data for the stored document. 

HARDWARE OVERVIEW 

Figure 2 is a block diagram that illustrates a computer system 200 upon which an 
embodiment of the invention may be implemented. Computer system 200 includes a bus 
202 or other communication mechanism for communicating information, and a processor 
204 coupled with bus 202 for processing information. Computer system 200 also 
includes a main memory 206, such as a random access memory (RAM) or other dynamic 
storage device, coupled to bus 202 for storing information and instructions to be executed 
by processor 204. Main memory 206 also may be used for storing temporary variables or 
other intermediate information during execution of instructions to be executed by 
processor 204. Computer system 200 further includes a read only memory (ROM) 208 or 
other static storage device coupled to bus 202 for storing static information and 
instructions for processor 204. A storage device 210, such as a magnetic disk or optical 
disk, is provided and coupled to bus 202 for storing information and instructions. 

Computer system 200 may be coupled via bus 202 to a display 212, such as a 
cathode ray tube (CRT), for displaying information to a computer user. An input device 
214, including alphanumeric and other keys, is coupled to bus 202 for communicating 
information and command selections to processor 204. Another type of user input device 
is cursor control 216, such as a mouse, a trackball, or cursor direction keys for 
communicating direction information and command selections to processor 204 and for 
controlling cursor movement on display 212. This input device typically has two degrees 
of freedom in two axes, a first axis (e.g., x) and a second axis (e.g., y), that allows the 
device to specify positions in a plane. 

The invention is related to the use of computer system 200 for implementing the 
techniques described herein. According to one embodiment of the invention, those 
techniques are performed by computer system 200 in response to processor 204 executing 
one or more sequences of one or more instructions contained in main memory 206. Such 
instructions may be read into main memory 206 from another computer-readable 
medium, such as storage device 210. Execution of the sequences of instructions 
contained in main memory 206 causes processor 204 to perform the process steps 
described herein. In alternative embodiments, hard-wired circuitry may be used in place 
of or in combination with software instructions to implement the invention. Thus, 
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embodiments of the invention are not limited to any specific combination of hardware 
circuitry and software. 

The term "computer-readable medium" as used herein refers to any medium that 
participates in providing instructions to processor 204 for execution. Such a medium may 
take many forms, including but not limited to, non-volatile media, volatile media, and 
transmission media. Non-volatile media includes, for example, optical or magnetic disks, 
such as storage device 210. Volatile media includes dynamic memory, such as main 
memory 206. Transmission media includes coaxial cables, copper wire and fiber optics, 
including the wires that comprise bus 202. Transmission media can also take the form of 
acoustic or light waves, such as those generated during radio-wave and infra-red data 
communications. 

Common forms of computer-readable media include, for example, a floppy disk, a 
flexible disk, hard disk, magnetic tape, or any other magnetic medium, a CD-ROM, any 
other optical medium, punchcards, papertape, any other physical medium with patterns of 
holes, a RAM, a PROM, and EPROM, a FLASH-EPROM, any other memory chip or 
cartridge, a carrier wave as described hereinafter, or any other medium from which a 
computer can read. 

Various forms of computer readable media may be involved in carrying one or 
more sequences of one or more instructions to processor 204 for execution. For example, 
the instructions may initially be carried on a magnetic disk of a remote computer. The 
remote computer can load the instructions into its dynamic memory and send the 
instructions over a telephone line using a modem. A modem local to computer system 
200 can receive the data on the telephone line and use an infra-red transmitter to convert 
the data to an infra-red signal. An infra-red detector can receive the data carried in the 
infra-red signal and appropriate circuitry can place the data on bus 202. Bus 202 carries 
the data to main memory 206, from which processor 204 retrieves and executes the 
instructions. The instructions received by main memory 206 may optionally be stored on 
storage device 210 either before or after execution by processor 204. 

Computer system 200 also includes a communication interface 218 coupled to bus 
202. Communication interface 218 provides a two-way data communication coupling to 
a network link 220 that is connected to a local network 222. For example, 
communication interface 218 may be an integrated services digital network (ISDN) card 
or a modem to provide a data communication connection to a corresponding type of 
telephone line. As another example, communication interface 218 may be a local area 
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network (LAN) card to provide a data communication connection to a compatible LAN. 
Wireless links may also be implemented. In any such implementation, communication 
interface 218 sends and receives electrical, electromagnetic or optical signals that carry 
digital-data streams representing various types of information. 

Network link 220 typically provides data communication through one or more 
networks to other data devices. For example, network link 220 may provide a connection 
through local network 222 to a host computer 224 or to data equipment operated by an 
Internet Service Provider (ISP) 226. ISP 226 in turn provides data communication 
services through the world wide packet data communication network now commonly 
referred to as the "Internet" 228. Local network 222 and Internet 228 both use electrical, 
electromagnetic or optical signals that carry digital data streams. The signals through the 
various networks and the signals on network link 220 and through communication 
interface 218, which carry the digital data to and from computer system 200, are 
exemplary forms of earner waves transporting the information. 

Computer system 200 can send messages and receive data, including program 
code, through the network(s), network link 220 and communication interface 218. In the 
Internet example, a server 230 might transmit a requested code for an application program 
through Internet 228, ISP 226, local network 222 and communication interface 218. 

The received code may be executed by processor 204 as it is received, and/or 
stored in storage device 210, or other non-volatile storage for later execution. In this 
manner, computer system 200 may obtain application code in the form of a carrier wave. 

In the foregoing specification, embodiments of the invention have been described 
with reference to numerous specific details that may vary from implementation to 
implementation. Thus, the sole and exclusive indicator of what is the invention, and is 
intended by the applicants to be the invention, is the set of claims that issue from this 
application, in the specific form in which such claims issue, including any subsequent 
correction. Any definitions set forth herein for terms contained in such claims shall 
govern the meaning of such terms as used in the claims. Hence, no limitation, element, 
property, feature, advantage or attribute that is not expressly recited in a claim should 
limit the scope of such claim in any way. The specification and drawings are, 
accordingly, to be regarded in an illustrative rather than a restrictive sense. 
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Appendix I 

■ Introducing XML Schema 

. Introducing XML Schema and Oracle XML DB 

. Using Oracle XML DB and XML Schema 

. Introducing DBMS.XMLSCHEMA 

. Registering Your XML Schema Before Using Oracle XML DB 

■ Deleting Your XML Schema Using DBMS JCMLSCHEMA 
. Guidelines for Using Registered XML Schcmas 

. Java Bean Generation During XML Schema Registration 

. Generating XML Schema from Object-Relational Types Using DBMS. 
XMLSCHEMA.generateScherna() 

. XML Schema-Related Methods of XMLType 

■ Managing and Storing XML Schema 
. DOM Fidelity 

. Oracle XML DB Creates XMLType Tables and Columns Based on XML Schema 

. Using SQLName and SQLType Attributes to Specify SQL Object Type Names 
Before Registering XML Schema 

. Mapping of Types Using DBMS JCMLSCHEMA 

• XML Schema : Mapping SimpleTypes to SQL 

. XML Schema: Mapping ComplexTypes to SQL 

Object-Relational Mapping of XMLTyp A-1 
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■ Oracle XML DB complexType Extensions and Restrictions 

. Further Guidelines for Creating XML Schema-Based XML Tables 

m Query Rewrite with XML Schema-Based Object-Relational Storage 

. Creating Default Tables During XML Schema Registration 

■ Ordered Collections in Tables (OCTs) 

■ Cyclical References Between XML Schemas 
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Introducing XML Schema and Oracle XML DB 



Introducing XML Schema 

The XML Schema recommendation was created by the World Wide Web 
Consortium (W3C) to describe the content and structure of XML documents in 
XML. It includes the full capabilities of Document Type Definitions (DTDs) so that 
existing DTDs can be converted to XML schema. XML schemas have additional 
capabilities compared to DTDs. 



Introducing XML Schema and Oracle XML DB 

XML Schema is a schema definition language written in XML. It can be used to 
describe the structure and various other semantics of conforming instance 
documents. For example, the following XML schema definition, po.xsd, describes 
the structure and other properties of purchase order XML documents. 

This manual refers to XML schema definitions as XML schema. 
Example 5-1 XML Schema Definition, po.xsd 

— The following is an example of an XML schema definition, po.xsd: 
<schema targetNamespace="http : //www. oracle .com/ PO. xsd" 
xmlns:po= n http: / /www. oracle.com/PO. xsd" 
xmlns="http: //www.w3 .org/2001/XIC£cheira ,, > 
<complexType name="PurchaseQrd9rType"> 
<sequence> 
<element naire="PONum n type= "decimal n /> 
<element name=" Company "> 
<simpleType> 
restriction base= n string"> 
<maxLength value="100"/> 
</ restriction 
</simpleType> 
</element> 

<element riame^Item" maxOccurs= ,, 1000"> 
<complexType> 
<sequence> 
<element nam2="Part M > 
<siitpleType> 
restriction base= B string "> 
<maxLength value="1000 M /> 
</restriction> 
</simpleType> 
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</element> 

<element name=" Price" type=" float "/> 
</sequence> 
</camplexType> 
</element> 
</sequence> 
< /complexType> 

<element nane="PurchaseOrder M type= "po : PurchaseOrderType " /> 
</schema> 

Example 5-2 XML Document, po.xml Conforming to XML Schema, po.xsd 

— Hie following is an example of an XML document that conforms to XML schema 
po.xsd: 

<PurchaseOrder xmlns="http: / MAv.pracle.com/ PO.xsd" 
xmlns : xs i= " ht tp : / /www . w3 . org/2 001 /XMLSchema- ins tance n 
xsi : schemaLocation= "http : / /www . oracle . com/PO . xsd 
ht tp : / /www . oracle . com/PO . xsd" > 
<PONum>1001</PCNum> 
<Campany>Oracle Corp</Company> 
<Item> 
<Part>9i Doc Set</Part> 
<Price>2550</Price> 
</Item> 
< / PurchaseOrder> 
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Using Oracle XML DB and XML Schema 



Note: 

The URL 'http://www.oracle.com/PO.xsd' used here is 
simply a name that uniquely identifies the registered XML schema 
within the database and need not be the physical URL at the which 
the XML schema document is located. Also, the target namespace 
of the XML schema is another URL, different from the XML schema 
location URL, that specifies an abstract namespace within which 
elements and types get declared. 

An XML schema can optionally specify the target namespace URL. 
If this attribute is omitted, the XML schema has no target 
namespace. Note : The targetnamespace is commonly the same 
as XML schema's URL. 

An XML instance document must specify both the namespace of 
the root element (same as the XML schema's target namespace) and 
the location (URL) of the XML schema that defines this root 
element. The location is specified with attribute 
xsi ; schemaLocation. When the XML schema has no target 
namespace, use attribute xsi :noNamespac eSchema Location to 
specify the XML schema URL. 



Using Oracle XML DB and XML Schema 

Oracle XML DB uses annotated XML schema as metadata, that is, the standard 
XML Schema definitions along with several Oracle XML DB-defined attributes. 
These attributes are in a different namespace and control how instance documents 
get mapped into the database. Since these attributes are in a different namespace 
from the XML schema namespace, such annotated XML schemas are still legal XML 
schema documents: 



When using Oracle XML DB, you must first register your XML schema. You can 
then use the XML schema URLs while creating XMLType tables, columns, and 
views. 

Oracle XML DB provides XML schema support for the following tasks: 
■ Registering any W3C compliant XML Schema. 
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Using Oracle XML DB and XML Schema 



o Validating your XML documents against a registered XML schema definitions. 

□ Registering local and global XML schemas. 

□ Generating XML schema from object types. 

o Referencing an XML schema owned by another user. 

□ Explicitly referencing a global XML schema when a local XML schema exists 
with the same name . 

□ Generating a structured database mapping from your XML schemas during 
XML schema registration. This includes generating SQL object types, collection 
types, and default tables, and capturing the mapping information using XML 
schema attributes. 

a Specifying a particular SQL type mapping when there are multiple legal 
mappings. 

o Creating XMLType tables, views and columns based on registered XML 
schemas. 

□ Performing manipulation (DML) and queries on XML schema-based XMLType 
tables. 

□ Automatically inserting data into default tables when schema-based XML 
instances are inserted into Oracle XML DB Repository using FTP, 
HTTP/ WebDav protocols and other languages. 

Why Do We Need XML Schema? 

XMLType is a datatype that facilitates 

storing XML in columns and tables in the database. XML schemas further facilitate 
storing XML columns and tables in the database, and they offer you more storage 
and access options for XML data along with space- performance-saving options. 

For example, you can use XML schema to declare which elements and attributes can 
be used and what kinds of element nesting, and datatypes are allowed in the XML 
dociunents being stored or processed. 

XML Schema Provide Flexible XML-to-SQL Mapping Set Up 

Using XML schema with Oracle XML DB provides a flexible set up for XML storage 
mapping. For example: 

a If your data is highly structured (mostly XML), each element in the XML 
documents can be stored as a column in a table. 
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■ If your data is unstructured (all or mostly non-XML data), the data can be 
stored in a Character Large Object (CLOB). 

Which storage method you choose depends on how your data will be used and 
depends on the queriability and your requirements for querying and updating your 
data. In other words. Using XML schema gives you more flexibility for storing 
highly structured or unstructured data, 

XML Schema Allows XML Instance Validation 

Another advantage for using XML schema with Oracle XML DB is that you can 
perform XML instance validation according to the XML schema and with respect to 
Oracle XML Repository requirements for optimal performance. For example,an 
XML schema can check that ail incoming XML documents comply with definitions 
declared in the XML schema, such as allowed structure, type, number of allowed 
item occurences, or allowed length of items. 

Also, by registering XML schema in Oracle XML DB, when inserting and storing 
XML instances using Protocols, such as FTP or HTTP, the XML schema information 
can influence how efficiently XML instances are inserted. 

When XML instances must be handled without any prior information about them, 
XML schema can be useful in predicting optimum storage, fidelity, and access. 

Introducing DBMSJCMLSCHEMA 

Oracle XML DB's XML schema functionality is available through the PL/SQL 
supplied package, DBMS_XML SCHEMA, a server-side component that handles the 
registration of XML schema definitions for use by Oracle XML DB applications. 



Two of the main DBMS_xml SCHEMA functions are: 

. regi sterSchema ( ) . This registers an XML schema given: 

. XML schema source, which can be in a variety of formats, including string, 
LOB, XMLType, and URIType 

a Its schema URL or XMLSchema name 

■ deleteSchema ( ) . This deletes a previously registered XML schema, 
identified by its URL or XMLSchema name. 
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Registering Your XML Schema Before Using Oracle XML DB 

An XML schema must be registered before it can be used or referenced in any 
context by Oracle XML DB. XML schema are registered by using DBMS_ 
XMLSCHEMA . regi s terSchema ( ) and specifying the following: 

■ The XML schema source document as a VARCHAR, CLOB, XMLType, or 
URIType. 

■ The XML schema URL. This is a name for the XML schema that is used within 
XML instance documents to specify the location of the XML schema to which 
they conform. 

After registration has completed: 

■ XML documents conforming to this XML schema, and referencing it using the 
XML schema's URL within the XML document, can be processed by Oracle 
XML DB. 

■ Tables and columns can be created for root XML elements defined by this XML 
schema to store the conforming XML documents. 

Registering Your XML Schema using DBMS^XMLSCHEMA 

Use DBMS_XMLSCHEMA to register your XML schema. This involves specifying the 
XML schema document and its URL, also known as the XML schema location. 

Example 5-3 Registering an XML Schema That Declares a complexType Using 
DBMS_XML SCHEMA 

Consider the XML schema shown below. It declares a complexType called 
PurchaseOrderType 

— and an element PurchaseQrder of this type. The schema is stored in the 

— PL/SQL variable doc. The following registers the XML schema at URL: 

— http://www.oracle.com/PO.xsd. 

declare 

doc varchar2{ 1000) :=' '<schema 
targetNamespace= " http : / /www . oracle . cam/ PO . xsd" 
xmlns : po= " http : / /www . oracle . com/ PO . xsd" 
mLns="http: //www.w3 .org/2001/XMLSchema"> 
<completfiype name= n PurchaseOrderType ■ > 
<sequence> 

<element name= 11 PCNum" type= M dec iiral "/> ' 
<element name= "Company" > 
<simpleType> 
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restriction base-" string" > 
<maxLength value*" 100 "/> 
</restriction> 
</sinple J IVpe> 
</element> 

<element name="Itern° imxOccurs= n 1000 n > 
<complexType> 
<sequence> 
<element name="Part n > 
<sinpleTVpe> 
restriction base= rt string M > 
<maxLength valued 1000 V> 
</restriction> 
</sirrpleType> 
</element> 

<elerrent name= n Price" type=" float" /> 
</sequence> 
< /corplexType> 
</element> 
</sequence> 
</ccnplex r IVpe> 

<element nama= " PurchaseOrder " t^pe= B po:PurchaseOrder < IVpe , 7> 
</schema>' ; 
begin 

dbmsjxmlschena . regis terSchema { ' http : //www. oracle . com/PO .xsd' , doc) ; 

end; 

— The registered schema can be used to created XMLSchema- Based tables, or 

— XMLSchema -based columns. For example, the following statement creates an 

— a table with an XMLSchema-based column, 
create table po_tab( 

id number, 

po sys.XMLType 

) 

xmltype column po 

XMLSCHEMA M http: //www. oracle. com/PO. xsd" 
elament "PurchaseOrder"; 

— The following shows an XMLType instance that conforms to the preceding XML 

— schema being inserted into the above table. Hie schemaLocation attribute 

— specifies the schema URL: 

insert into po_tab values (1, 

xmltype ( ' < PurchaseOrder xmlns= " http : / /www . oracle . com/ PO . xsd" 
xmlns:xsi="http: / /www. w3 .org/2 001 /XMLSchema- instance" 
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xs i : schemaLocat ion= "ht tp : / /www . oracle . cam/ PO . xsd 
ht tp :/ /www . oracle . can/ PO . xsd M > 
<PCNam>1001</PQNuni> 
<Carrpany>Qracle Corp</Canpany> 
<Item> 

<Part>9i Doc Set</Part> 
<Price>2550</Price> 
</Item> 
<Item> 

<Part>8i Doc Set</Part> 
<Price>350</Price> 
</Item> 
< / PurchaseOrder> ' ) ) ; 



Local and Global XML Schemas 

XML schemas can be registered as local or global: 

■ Local XML schema: An XML schema registered as a local schema is, by default, 
visible only to the owner. 

■ Global XML schema: An XML schema registered as a global schema is, by 
default, visible and usable by all database users. 

When you register an XML schema, DBMS_XMLSCHEMA adds an Oracle XML DB 
resource corresponding to the XML schema into the Oracle XML DB Repository. 
The XML schema URL determines the path name of the resource in Oracle XML DB 
Repository according to the following rules: 

Local XML Schema 

In Oracle XML DB, local XML schema resources are created under 

/sys /schemas /<username> directory. The rest of the path name is derived from 

the schema URL. 

Example 5-4 A Local XML Schema 

For example, a local XML schema with schema URL: 

http://www.myco.com/PO.xsd 

registered by SCOTT, is given the path name: 
/ sys / schemas / SCOTT/www . m/co . com/ PO . xsd . 
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Database users need appropriate permissions (ACLs) to create a resource with this 
path name in order to register the XML schema as a local XML schema. 



By default, an XML schema belongs to you after registering the XML schema with 
Oracle XML DB. A reference to the XML schema document is stored in Oracle XML 
DB Repository, in directory: 

/sys/schenas/<username>/ 

For example, if you, SCOTT, registered the preceding XML schema, it is mapped to 
the file: 

/ sys / s charas / SCOTT/www . orac le . cam/ PO . xsd 

Such XML schemas are referred to as local. In general, they are usable only by you 
to whom they belong. 

Note: Typically, only the owner of the XML schema can use it to 
define XMLType tables, columns, or views, validate documents, and 
so on. However, Oracle supports fully qualified XML schema URLs 
which can be specified as: 

http : / /xmlns . oracle . com/xdb/ schemas / SCOTT/ www . orac 
le. coin/PO.xsd 

This extended URL can be used by privileged users to specify XML 
schema belonging to other users. 



Global XML Schema 

In contrast to local schema, privileged users can register an XML schema as a global 
XML schema by specifying an argument in the DBMS_XML SCHEMA registration 
function. 

Global schemas are visible to all users and stored under the 

/ sys / schemas / PUBLIC / directory in Oracle XML DB Repository. 
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Note: Access to this directory is controlled by Access Control Lists 
( ACLs) and, by default, is writeable only by a DBA. You need 
WRITE privileges on this directory to register global schemas. 

XDBAdmin role also provides WRITE access to this directory 
assiuning that it is protected by the default "protected" ACL. 



You can register a local schema with the same URL as an existing global schema. A 
local schema always hides any global schema with the same name (URL). 

Example 5-5 A Global XML Schema 

For example, a global schema registered by SCOTT with the URL: 
www.rryco.com/P0.xsd 

is mapped to Oracle XML DB Repository at: 

/sys / schemas / PUBLIC /www . myco . com/ P0 . xsd 

Database users need appropriate permissions (ACLs) to create this resource in 
order to register the XML schema as global 

Registering Your XML Schema: Oracle XML DB Sets Up the Storage and Access 
Infrastructure 

As part of registering an XML schema, Oracle XML DB also performs several other 
steps to facilitate storing, accessing, and manipulating XML instances that conform 
to the XML schema. These steps include: 

■ Creating types: When an XML schema is registered, Oracle creates the 
appropriate SQL object types that enable the structured storage of XML 
documents that conform to this XML schema. You can use Oracle XML 
DB-defined attributes in XML schema documents to control how these object 
types are generated. 
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■ Creating default tables: As part of XML schema registration, Oracle XML DB 
generates default XMLType tables for all root elements. You can also specify any 
column and table level constraints for use during table creation. 



■ Creating Java beans: Java beans can be optionally generated during XML 
schema registration. These Java classes provide accessor and mutator methods 
for elements and attributes declared in the schema. Access using Java beans 
offers better performance for manipulating XML when the XML schema is well 
known. This helps avoid run-time name translation. 

Deleting Your XML Schema Using DBMS_XMLSCHEMA 

You can delete your registered XML schema by using the DBMS_ 

XML SCHEMA . deleteSchema procedure. When you attempt to delete an XML 

schema, DBMS_XMLSCHEMA checks: 

« That the current user has the appropriate privileges ( ACLs) to delete the 

resource corresponding to the XML schema within Oracle XML DB Repository. 
You can thus control which users can delete which XML schemas by setting the 
appropriate ACLs on the XML schema resources. 

■ For dependents. If there are any dependents, it raises an error and the deletion 
operation fails. This is referred to as the RESTRICT mode of deleting XML 
schemas. 

FORCE Mode 

A FORCE mode option is provided while deleting XML schemas. If you specify the 
FORCE mode option, the XML schema deletion proceeds even if it fails the 
dependency check. In this mode, XML schema deletion marks all its dependents as 
invalid. 

CASCADE Mode 

The CASCADE mode option drops all generated types, default tables, and Java beans 
as part of a previous call to register schema. 

See Also: OracleSi XML API Reference - XDK and XDB chapter on 
DBMS.XMLSCHEMA 
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Example 5-6 Deleting the XML Schema Using DBMS^XMLSCHEMA 

— The following exairple deletes XML schema PO.xsd. First, the dependent table 

— po_tab is dropped. Then, the schema is deleted using the FORCE and CASCADE 

— modes with DBMS_XMLSCHEMA . DELETESCHEMA . 

drop table po_tab; 

EXBC dbms __xmlschema . deleteSchema ( ' http : / /www . oracle . com/ PO . xsd ' , 
dbns^xrnl schema . DELEJIEjC7\SCADE_F0RCE) ; 

Guidelines for Using Registered XML Schemas 

The following sections describe guidelines for registering XML schema with Oracle 
XML DB. 

Objects That Depend on Registered XML Schemas 

The following objects depend on a registered XML schemas: 

■ Tables or views that have an XMLType column that conforms to some element 
in the XML schema. 

■ XML schemas that include or import this schema as part of their definition. 

■ Cursors that reference the XML schema name, for example, within DBMS_ 
XMLGEN operators. Note that these are purely transient objects. 

Creating XMLType Tables, Views, or Columns 

After an XML schema has been registered, it can be used to create XML 
schema-based XMLType tables, views, and columns by referencing the following: 

■ The XML schema URL of a registered XML schema 

■ The name of the root element 

Example 5-7 Post-Registration Creation of an XMLType Table 

— For example you can create an XMLSchema-based XMLType table as follows : 
CREATE TABLE po_tab OF XMLTYPE 

XMLSCHEMA "http: //www. oracle. com/ PO.xsd" ELEMENT "PurchaseOrder" ; 

— The following statement inserts schema-conformant data, 
insert into po__tab values ( 

xmltype ( ' <PurchaseQrder xmlns= "http : / /www. oracle . com/PO . xsd" 
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xmlns:xsi=''http: //www.w3 .org/2 OOl/XMLSchena-instance'' 
xsi : schemaLocation= "http: / /www . oracle . com/FO. xsd 
ht tp : / /www . oracle . cam/ PO . xsd" > 
<PONum>1001< / PQNuir> 
<Corrpany>Oracle Corp</Coiipany> 
<Item> 

<Part>9i Doc Set</Part> 
<Price>255Ck/Price> 
</Item> 
<Item> 

<Part>8i Doc Set</Part> 
<Price>350</Price> 
</Item> 
</PurchaseQrder>' ) ) ; 

Validating XML Instances Against the XML Schema: schemaValidateQ 

You can validate an XMLType instance against a registered XML schema by using 
one of the validation methods. 



Example 5-5 Validating XML Using schemaValidateQ 

— The following PL/SQL example validates an XML instance against XML schema 

PO.xsd: 

declare 

xmldoc xmltype; 

begin 

— populate xmldoc (by fetching from table) 
select value (p) into xmldoc from po_tab p; 

validate against XML schema 
xmldoc . scheraval idat e ( ) ; 

if xmldoc. isschemavalidatedO = 1 then 

aara_output.put_line( 'Data is valid' ) ; 

else 

dfcms_output.put_line( 'Data is invalid' ) ; 

end if; 
end; 
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Fully Qualified XML Schema URLs 

By default, XML schema URL names are always referenced within the scope of the 
current user. In other words, when database users specify XML schema URLs, they 
are first resolved as the names of local XML schema owned by the current user. 

■ If there are no such XML schemas, then they are resolved as names of global 
XML schema. 

■ If there are no global XML schema, then Oracle XML DB raises an error. 
XML Schema That Users Cannot Reference 

These rules imply that, by default, users cannot reference the following kinds of 
XML schemas: 

■ XML schemas owned by a different database user 

■ Global XML schemas that have the same name as local XML schemas 

Fully Qualified XML Schema URLs Permit Explicit Reference to XML Schema 
URLs 

To permit explicit reference to XML schemas in these cases, Oracle XML DB 
supports a notion of hilly qualified XML schema URLs. In this form, the name of the 
database user owning the XML schema is also specified as part of the XML schema 
URL, except that such XML schema URLs belong to the Oracle XML DB namespace 
as follows: 

http: //xmlns .oracle. com/xdJb/schemas/<database-user-name>/<schemaURL- 
minus-protocol> 

Example 5-9 Using Fully Qualified XML Schema URL 

— For exarrple, consider the global XML schema with the following URL: 
http : / /www . exarrple . com/po . xsd 

— Assume that database user SCOTT has a local XML schema with the saire URL: 
ht tp : / / www . example . com/po . xsd 

— User JOE can reference the local XML schema owned by SCOTT as follows: 
http : / /xmlns . oracle . ccWxdb/schemas/SCOTT/www. example . com/po . xsd 

— Similarly, the fully qualified URL for the global XML schema is: 
http : //xmlns . oracle . com/xdb/schemas/ PUBLIC /www. exarrple . com/po . xsd 
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Transactional Behavior of XML Schema Registration 

Registration of an XML schema is non transactional and auto committed as with 
other SQL DDL operations, as follows: 
■ If registration succeeds, the operation is auto committed. 
. If registration fails, the database is rolled back to the state before the registration 
began. 

Since XML schema registration potentially involves creating object types and tables, 
error recovery involves dropping any such created types and tables. Thus, the 
entire XML schema registration is guaranteed to be atomic. That is, either it 
succeeds or the database is restored to the state before the start of registration. 

Java Bean Generation During XML Schema Registration 

Java beans can be optionally generated during XML schema registration and 
provide accessor and mutator methods for elements and attributes declared in the 
XML schema. Access to XML data stored in the database, using Java beans, offers 
better performance for manipulating the XML data when the XML schema is well 
known and mostly fixed by avoiding run-rime name translation. 

Example 5-10 Generating Java Bean Classes During XMI Schema Registration 

For example, the Java bean class corresponding to the XML schema PO . xsd has the 
following accessor and mutator methods: 

public class PurchaseOrder extends XMLTypeBean 
{ 

public BigDecirral getPONumO 
{ 

} 

public void setPONum(BigDeciirctl val) 
{ 

} 

public String getConpanyO 
{ 

} 

public void setConpany (String val) 
{ 
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} 



} 



Note: Java Bean support in Oracle XML DB is only for XML 
schema-based XML documents. Non-schema-based XML 
documents can be manipulated using Oracle XML DB DOM API. 



Generating XML Schema from Object-Relational Types Using DBMS_ 
XMLSCHEMA.generateSchema() 

An XML schema can be generated from an object-relational type automatically 
using a default mapping. The genera teSchema ( ) and generateSchemas () 
functions in the DBMS_XMLSCHEMA package take in a string that has the object type 
name and another that has the Oracle XML DB XMLschema. 

■ generateSchema { ) returns an XMLType containing an XML schema. It can 
optionally generate XML schema for all types referenced by the given object 
type or restricted only to the top-level types. 

■ generateSchemas { ) is similar, except that it returns an XMLSequenceType 
of XML schemas, each corresponding to a different namespace. It also takes an 
additional optional argument, specifying the root URL of the preferred XML 
schema location: 

http : //xmlns . oracle . com/xdb/schemas/<schena> . xsd 

They can also optionally generate annotated XML schemas that can be used to 
register the XML schema with Oracle XML DB. 



Example 5-1 1 Generating XML Schema: Using generateSchemaf) 

— For example, given the object type: 
connect tl/tl 

CREATE TYPE enployee_t AS OBJECT 
( 

empno NUMBER (10) , 
ename VARCKAR2 (200) , 
salary NUMBER (10 ,2) 

); 

— We can generate the schema for this type as follows : 
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select dhrs_^sdiena.generateschena( i Tl' i ' EMPLOYEES ') from dual; 

— This returns a schema corresponding to the type EMPLOYEEJT. The schema 

— declares an ELEMENT named EMPLOYEEJT and a CCMPLEXTYPE called EHPLOYEEJIT/pe . 
-- The schema includes other annotation from http://xmlns. oracle.com/xdb. 

DBMS_XMLSCHH , 1A . GENERATESCHEMA { ' Tl ' , 'EMPLOYEE_T' ) 



<xsd: schema targetNamespace="http : //ns . oracle .ccm/xdb/Tl " xmlns="http : //ns . oracl 
e.coiv'xaT3/Tl"-xinlr^ xmlns :xdb=° http: //xml 

ns.oracle.com/xdb" xmlns :xsi=" http://www.w3 .org/ 2001 /XMLSchema- instance" xsi:sch 
emaLocat ion= "http : / /xmlns . oracle . cam/xdb http : / /xmlns . oracle . com/xdb/XDBSchema . x 
sd"> 

<xsd: element name= " EMPLOYEE_T ■ type= tt E^LOYEE_TIVpe n xdb : SQLType= " EMPLGYE£_T" 
xdb : SQLSchema="Tl V> 

<xsd:complexlVpe name= " mPUJTEEjrType " > 
<xsd: sequence> 

<xsd: element name="EMENO n type= n xsd: double" xdb : SQLName= n EKFNO" xdb:SQLTyp 
e= " NUMBER" /> 

<xsd: element name="EMAME" type="xsd: string" xdb : SQIName= " ENAME" xdb:SQLTVp 
e="VARCHAR2«7> 

<xsd: element name= " SALARY " type="xsd: double" xdb: SQI2tfaire= M &^ARY M xdb : SQLT 
ype="NUMBER'7> 

</xsd: sequence> 
</xsd : ccmplexType> 
</xsd:schema> 
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XML Schema-Related Methods of XMLType 

Table 5-1 lists the XMLType API's XML schema-related methods. 



Table 5-f XMLType API XML Schema-Related Methods 



XMLType API Method 


Description 


isSchemaBased() 


Returns TRUE if the XMLType instance is based on an XML schema, FALSE 




otherwise. 


getSchemaURL() 


Returns the XML schema URL, name of root element, and the namespace for an 


getRootElement() 


XML schema-based XMLType instance. 


getNamespace() 




schemaValidateQ 


An XMLType instance can be validated against a registered XML schema using 


isSchemaValidQ 


the validation methods. 


is SchemaValidatedf) 




setSchemaVafidated() 





Managing and Storing XML Schema 

XML schema documents are themselves stored in Oracle XML DB as XMLType 
instances. XML schema-related XMLType types and tables are created as part of the 
Oracle XML DB installation script, catxdbs . sgl . 



Root XML Schema, XDBSchema.xsd 

The XML schema for XML schemas, is called the root XML schema, 
XDBSchema . xsd. XDBSchema . xsd describes any valid XML schema document 
that can be registered by Oracle XML DB. You can access XDBSchema . xsd through 
Oracle XML DB Repository at: 

/sys/schsTms/PUBLIC/xmlns . oracle . con/xdb/XDBSchema .xsd 
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How Are XML Schema-Based XMLType Structures Stored? 

XML Schema-based XMLType structures are stored in one of the following ways: 
■ In underlying object type columns. This is the default storage mechanism. 

- SQL object types can be created optionally during the XML schema 
registration process. 

- Mappings from XML to SQL object types and attributes, is stored in the 
XML schema document as extra annotations, that is, as attributes defined 
by Oracle XML DB and defined in http://xmlns.orade.com/xdb. 



■ In a single underlying LOB column. Here the storage choice is specified in the 
STORE AS clause of the CREATE TABLE statement: 

CREATE TABLE po_tab OF xmltype 
STORE AS CLOB 

ELEMENT "http: //www. oracle. can/PO.xsd#PurchaseQrder n ; 



Specifying the Storage Mechanism 

Instead of using the STORE AS clause, you can specify that the table and column be 
stored according to a mapping based on a particular XML schema. You can specify 
the URL for the XML schema used for the mapping. 

Non-XML schema-based XML data can be stored in tables using CLOBs. However 
you do not obtain benefits such as indexing, query-rewrite, and so on. 

DOM Fidelity 

Document Object Model (DOM) fidelity is the concept of retaining the structure of a 
retrieved XML document, compared to the original XML document, for DOM 
traversals. DOM fidelity is needed to ensure the accuracy and integrity of XML 
documents stored in Oracle XML DB. 
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How Oracle XML DB Ensures DOM Fidelity with XML Schema 

All elements and attributes declared in the XML schema are mapped to separate 
attributes in the corresponding SQL object type. However, some pieces of 
information in XML instance documents are not represented directly by these 
element or attributes, such as: 

a Comments 

□ Namespace declarations 

a Prefix information 

To ensure the integrity and accuracy of this data, for example, when regenerating 
XML documents stored in the database, Oracle XML DB uses a data integrity 
mechanism called DOM fidelity. 

DOM fidelity refers to how identical the returned XML documents are compared to 
the original XML documents, particularly for purposes of DOM traversals. 



DOM Fidelity and SYS_XDBPD$ 

To guarantee that DOM fidelity is maintained and that the returned XML documents 
are identical to the original XML document for DOM traversals, Oracle XML DB 
adds a system binary attribute, SYS_XDBPD$, to each created object type. 

This attribute stores all pieces of information that cannot be stored in any of the 
other attributes, thereby ensuring the DOM fidelity of all XML documents stored in 
Oracle XML DB. Examples of such pieces of information include: ordering 
information, comments, processing instructions, namespace prefices, and so on. 

This is mapped to a Positional Descriptor (PD) column. 



Note: In general,it is not a good idea to set this information 
because the extra pieces of information, such as, comments, 
processing instructions, and so on, could be lost if there is no PD 
column. 



How to Suppress SYS_XDBPD$ 

If DOM fidelity is not required, you can suppress S YS_XDBPD$ in the XML schema 
definition by setting the attribute, main tainDOM= FALSE. 
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Note: The attribute SYS_XDBPD$ is omitted in many examples 
here for clarity. However, the attribute is always present as a 
Positional Descriptor (PD) column in all SQL object types generated 
by the XML schema registration process. 



Oracle XML DB Creates XMLType Tables and Columns Based on XML 
Schema 

Oracle XML DB creates XML Schema-based XMLType tables and columns by 
referencing: 

. The XML schema URL of a registered XML schema 

■ The name of the root element 

Figure 3 shows the syntax for creating an XMLType table: 

CREATE, TABLE [schema.] table OF XMLTYPE 
[XMLTYPE XMLType_storage] (XMLScheira^spec] ; 



A subset of the XPointer notation, shown in the following example, can also be used 
to provide a single URL containing the XML schema location and element name. 

Example 5-12 Creating XML Schema-Based XMLType Table 

This example creates the XMLType table po_tab using the XML schema at the 

given URL: 

CREATE TABLE po_tab OF XMLTYPE 

XMLSCHEMA - http://www.oracle.com/PO.xsd" ELEMENT "PurchaseOrder"; 

An equivalent definition is: 
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CREATE TABLE po_tab OF XMLTYPE 

ELEMENT n http://www. oracle. com/PO.xsd#PurchaseOrcler n ; 

SQL Object-Relational Types Store XML Schema-Based XMLType Tables 

When an XML schema is registered, Oracle XML DB creates the appropriate SQL 
object types that enable structured storage of XML documents that conform to this 
XML schema. All SQL object types are created based on the current registered XML 
schema, by default. 

Example 5-13 Creating SQL Object Types to Store XMLType Tables 

— For exanple, when PO.xsd is registered with Oracle XML DB, the following SQL 

types 

— are created. Note that the naines of the types are generated names, and will 
not 

-- nescessarily match Itemxxxj:, Itemxxx_COLL and PurchaseOrderTypexxx_T, where 
xxx 

— is a 3 -digit integer. 

CREATE TYPE "ItenKxxjr" as object 
( 

part varchar2 (1000) , 
price number 

); 

CREATE TYPE "Itemxxx.COLL" AS varray(lOOO) OF n Item_T"; 

CREATE TYPE "PurchasetoderTypexxxJT" AS OBJECT 

( 

ponum number, 
company varchar2{100) , 
item I tem_varr ay_COLL 
); 
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Note: The names of the object types and attributes in the 
preceding example can be system-generated. 

■ If the XML schema already contains the SQLName , 
SQLType , or SQLColType attribute filled in 

, this name 

is used as the object attribute's name. 

■ If the XML schema does not contain the SQLName attribute, the 
name is derived from the XML name, unless it cannot be used 
because of length or conflict reasons. 

If the SQLSchema attribute is used, Oracle XML DB attempts to 
create the object type using the specified database schema. The 
current user must have the necessary privileges to perform this. 



Using SQLName and SQLType Attributes to Specify SQL Object Type 
Names Before Registering XML Schema 

To specify specific names of SQL objects generated include the attributes SQLName 
and SQLType in the XML schema definition prior to registering the XML schema. 

. If you specify the SQLName and SQLType values, Oracle XML DB creates the 
SQL object types using these names. 

■ If you do not specify these attributes, Oracle XML DB uses system-generated 
names. 



Note: You do not have to specify values for any of these 
attributes. Oracle XML DB fills in appropriate values during the 
XML schema registration process: However, it is recommended 
that you specify the names of at least the top-level SQL types so 
that you can reference them later. 



All annotations are in the form of attributes that can be specified within attribute 
and element declarations. These attributes belong to the Oracle XML DB 
namespace: http : //xmlns . oracle . com/xdb 

Table 5-2 lists Oracle XML DB attributes that you can specify in element and 
attribute declarations. 



Object-Relational Mapping of XMLType 5-25 



62 



WO 03/030031 



PCT/US02/30783 



Using SGLName and SQLType Attributes to Specify SQL Object Type Names Before Registering XML Schema 



Table 5-2 AttributesYou Can Specify In Elements 


Attribute 


Values 


Default 


Description 


SQLName 


Any SQL identifier 


Element name 


Specifies the name of the attribute within 
the SQL object that maps to this XML 
element 


SQLType 


Any SQL type name 


Name generated Specifies the name of the SQL type 
from element name corresponding to this XM L 
element declaration. 


SQLCollType 


Any SQL collection 
type name 


lNdinc gcllcl dlcU 

from element name 


type corresponding to this XML element 
that has maxOccurs > 1. 


SQLSchema 


Any SQL username 


User registering 
XML schema 


Name of database user owning the type 
specified by SQLType. 


SQLCollSchema 


Any SQL username 


User registering 
XML schema 


Name of database user owning the type 
specified by SQLCollType. 


ma inta infi rrior 




true 


If true, the collection is mapped to a 
VARRAY. If false, the collection is 
mapped to a NESTED TABLE. 


SQLInline 


true | false 


true 


If true this element is stored inline as an 
embedded attribute (or a collection if 
maxOccurs > 1). If false, a REF (or 
collection of REFs if maxOccurs > 1) is 
stored. This attribute will be forced to 
false in certain situations (like cyclic 
references) where SQL will not support 
inlining. 


maintainDOM 


true | false 


true 


If true, instances of this element are 
stored such that they retain DOM fidelity 
on output. This implies that all comments, 
processing instructions, namespace 
declarations, and so on are retained in 
addition to the ordering of elements. If 
false, the output need not be guaranteed 
to have the same DOM behavior as the 
input. 
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Table 5-2 A ttributes You Can Specify in Elemen ts( Cont) mmmmt _ m 

Attribute Values Default Description , 

columnProps Any valid column NULL Specifies the column storage clause that is 

storage clause inserted into the default CREATE TABLE 

statement. It is useful mainly for elements 
that get mapped to tables , namely 
top-level element declarations and 
out-of-line element declarations. 

tableProps Any valid table NULL Specifies the TABLE storage clause that is 

storage clause appended to the default CREATE TABLE 

statement. This is meaningful mainly for 
global and out-oMine elements. 

defaultTable Any table name Based on element Specifies the name of the table into which 

name. XML instances of this schema should be 

stored. This is most useful in cases when 
the XML is being inserted from APIs 
where table name i s not s pecified, for 
example, FTP and HTTP. 



beanClassname Any Java class name Generated from Can be used within element declarations. 

element name. If the element is based on a global 
complexType, this name must be 
identical to the beanClassname value 
within the complexType declaration. If a 
name is specified by the user, the bean 
generation will generate a bean class with 
this name instead of generating a name 
from the element name. 

JavaClassnsme Any Java class name None Used to specify the name of a Java class 

that is derived from the corresponding 
bean class to ensure that an object of this 
class is instantiated during bean access. If 
a JavaC las sname is not specified, 
Oracle XML DB will instantiate an object 
of the bean class directly. 
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Table 5-3 Attributes You Can Specify In Elements Declaring Global complexTypes 



Attribute 



Values 



Default 



Description 

ited from Specifies the name of the SQL type 
e corresponding to this XML 

element declaration. 



SQLType 



Any SQL type name 



Name general 
element name 



SQLSchema Any SQL username User registering XML Name of database user owning the type 

schema specified by SQLType. 



beanClassname Any Java class name Generated from 

element name. 



Can be used within element declarations. 
If the element is based on a global 
complexType, this name must be 
identical to the beanClassname value 
within the complexType declaration. If a 
name is specified by the user, the bean 
generation will generate a bean class with 
this name, instead of generating a name 
from the element name. 



maintainDOM 



true | false 



true 



If true, instances of this element are 
stored such that they retain DOM fidelity 
on output. This implies that all comments, 
processing instructions, namespace 
declarations,.and so on, are retained in 
addition to the ordering of elements. If 
false, the output need not be guaranteed 
to have the same DOM behavior as the 
input. 



Table 5-4 Attributes You Can Specify in XML Schema Declarations 



Attribute 



Values 



Default 



Description 



mapUnboundedStringToLob true | false 



false 



If true, unbounded strings are mapped to 
CLOB by default. Similarly, unbounded 
binary data gets mapped to BLOB, by 
default. If false, unbounded strings are 
•mapped to VARCHAR2(4000) and 
unbounded binary components are 
mapped to RAW(2000). 



storeVarrayAsTable 



true I false 



false 



If true, the VARRAY is stored as a table 
(OCT). If false, the VARRAY is stored in a 
LOB. 
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SQL Mapping Is Specified in the XML Schema During Registration 

Information regarding the SQL mapping is stored in the XML schema document 
The registration process generates the SQL types, 
and adds annotations to the XML 

schema document to store the mapping information. Annotations are in the form of 
new attributes. 

Example 5-14 Capturing SQL Mapping Using SQLType and SQLName Attributes 

— The following XML schema definition shows how SQL mapping information 

— is captured using SQLType and SQLName attributes: 

declare 

doc varchar2 (3000) ;= '<schema 
targetNarrespace= "http : //www . oracle . com/PO .xsd n 

xmlns : po= " ht tp : / /www . oracle . com/PO . xsd° xmlns : xdb= " http : / /xmlns . oracle . com/xdb" 
xmlns^http: //www.w3 .org/2001/XMLSchema ,, > 
<carpletfType name= " PurchaseOrderType " > 
<sequence> 

<element rame="FONum". type= M decimal" xdb : SQLName= H POJUM" 
xdb : SQLType= " NUMBER 0 /> 

<element naire= "Company" xdb : SQLNane="Ca^ANY" xdb : SQLType= " VARCHAR2 " > 
<simpleType> 
restriction base=" string "> 
<maxLength value="100 n /> 
< /res trie tion> 
</simpleType> 
</element> 

<element name="Item" xdbrSQLName^-ITH^" xdb : SQLType= " ITEM_T" 
maxOccurs= n 1000"> 
<corrplexType> 
<sequence> 

<element naroe="Part n xdb : SQLName= " PART" xdb: SQLType ="VARCHAR2 fl > 
<siirpleType> 
restriction base=" string" > 
<maxLength valued 1000 "/> 
</restriction> 

</simpleType> 
</element> 

<element name="Price" type=" float" xdb : SQLNarre= " PRICE" 
xdb : SQLType= " NUMBER " / > 
</sequence> 
</complexType> 
</element> 
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</sequence> 
</ccffiplexType> 

<elGnnent nane= " PurchaseOrder " type= M po : PurchaseOrderType " /> 
</schena>' ; 
begin 

dbms _^anlschema . registerSchema ( ' http : / /www . oracle . cam/ PO . xsd ' , doc ) ; 
end; 

Figure 4 shows how Oracle XML DB creates XML schema-based XMLType tables 
using an XML document and mapping specified in an XML schema. An XMLType 
table is first created and depending on how the storage is specified in the XML 
schema, the XM1 document is mapped and stored either as a CLOB in one XMLType 
column, or stored object-relationally and spread out across several columns in the 
table. 
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An XMLType table is first created and depending on how the storage is specified in 
the XML schema, the XM1 document is mapped and stored either as a CLOB in one 
XMLType column, or stored object-relationally and spread out across several 
columns in the table. 
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Mapping of Types Using DBMS.XMLSCHEMA 

Use DBMS_XMLSCHEMA to set the mapping of type information for attributes and 
elements. 

Setting Attribute Mapping Type Information 

An attribute declaration can have its type specified in terms of one of the following: 

■ Primitive type 

■ Global s impl eType, declared within this XML schema or in an external XML 
schema 

■ Reference to global attribute (ref = ".."), declared within this XML schema or 
in an external XML schema 

■ Local simp leType 

In all cases, the SQL type and associated information (length and precision) as well 
as the memory mapping information, are derived from the simp leType on which 
the attribute is based. 

Overriding SQL Types 

You can explicitly specify an SQLType value in the input XML schema document. 
In this case, your specified type is validated. This allows for the following specific 
forms of overrides: 

■ If the default type is a STRING, you can override it with any of the following: 
CHAR, VARCHAR, or CLOB. 

■ If the default type is RAW, you can override it with RAW or BLOB. 

Setting Element Mapping Type Information 

An element declaration can specify its type in terms of one of the following: 
. Any of the ways for specifying type for an attribute declaration. 

■ Global complexType, specified within this XML schema document or in an 
external XML schema. 

■ Reference to a global element (r ef = "... ■ ), which could itself be within this 
XML schema document or in an external XML schema. 
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■ Local complexType. 

Overriding SQL Type 

An element based on a complexType is, by default, mapped to an object type 
containing attributes corresponding to each of the sub-elements and attributes. 
However, you can override this mapping by explicitly specifying a value for 
SQLType attribute in the input XML schema. The following values for SQLType are 
permitted in this case: 

. VARCHAR2 

. RAW 

■ CLOB 
. BLOB 

These represent storage of the XML in a text or unexploded form in the database. 
The following special cases are handled: 

. If a cycle is detected, as part of processing the complexTypes used to declare 
elements and elements declared within the omplexType), the SQLInline 
attribute is forced to be "false" and the correct SQL mapping is set to REF 
XMLTYPE. 

. IfmaxOccurs > 1, a VARRAY type may need to be created. 

- If SQLInl ine = " true " , a varray type is created whose element type is the 
SQL type previously determined. 

* Cardinality of the VARRAY is determined based on the value of 
maxOccurs attribute. 

* The name of the VARRAY type is either explicitly specified by the user 
using SQLCollType attribute or obtained by mangling the element 
name. 

- If SQLInline= " false \ the SQL type is set to XDB . XDB$XMLTYPE_REF_ 
LISTJT, a predefined type representing an array of REFs to XMLType. 

m If the element is a global element, or if SQLInl ine= - f alse", a default table 
needs to be created. It is added to the table creation context. The name of the 
default table has either been specified by the user, or derived by mangling the 
element name. 
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XML Schema: Mapping SimpleTypes to SQL 

This section describes how XML schema definitions are used to map XML schema 
simpleType to SQL object types. 

Table 5-5 through Table 5-8 list the default mapping of XML schema simpleType 
to SQL, as specified in the XML schema definition. For example: 

□ An XML primitive type is mapped to the closest SQL datatype. For example, 
DECIMAL, POSITIVE1NTEGER, and FLOAT are all mapped to SQL NUMBER. 

□ An XML enumeration type is mapped to an object type with a single RAW(n) 
attribute. The value of n is determined by the number of possible values in the 
enumeration declaration. 

□ An XML list or a union datatype is mapped to a string (VARCHAR2/CLOB) 
datatype in SQL. 

Table 5-5 Mapping XML String Datatypes to SQL 



XML 

Primitive 

Type 


Length or 

MaxLength 

Facet 


Default Mapping 


Compatible Datatype 


string 


n 


VARCHAR2(n) if n < 4000, 
elseVARCHAR2(4000) 


CHAR,VARCHAR2, 
CLOB 


string 




VARCHAR2(4000) if 
mapUnboundedStringToLo 
b="true'* / CLOB 


CHAR, VARCHAR2, CLOB 



Table 5-6 Mapping XML Binary Datatypes (hexBinary/base64Binary) to SQL 



XML Primitive 
Type 


Length or 
MaxLength 
Facet 


Default Mapping 


Compatible Datatypes 


hexBinary, 
base64Binary 


n 


RAW(n) if n < 2000, else RAW(2000) 


RAW, BLOB 


hexBinary 
base64Binary 




RAW(2000) if 

mapUnboundedStringToLob= ,, true M , 
BLOB 


RAW, BLOB 
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Table 5-7 Default Mapping of Numeric XML Primitive Types to SQL 


XML Simple Type 


Default 
Oracle 
DataType 


totalDigits (m), fractionuigitsm; 
Specified 


Compatible Datatypes 


float 


NUMBER 


NUMBER(m,n) 


NUMBER, FLOAT, DOUBLE 


double 


NUMBER 


NUMBER(m / n) 


NUMBER, FLOAT, DOUBLE 


decimal 


NUMBER 


NUMBER(m,n) 


NUMBER, FLOAT, DOUBLE • 


integer 


NUMBER 


NUMBER(m,n) 


NUMBER, FLOAT, DOUBLE 


nonNegativelnteger 


NUMBER 


NUMBER(m,n) 


NUMBER, FLOAT, DOUBLE 


positivelnteger 


NUMBER 


NUMBER(m,n) 


NUMBER, FLOAT, DOUBLE 


nonPositivelnteger 


NUMBER 


NUMBER(m,n) 


NUMBER, FLOAT, DOUBLE 


negativelnteger 


NUMBER 


NUMBER(m,n) 


NUMBER, FLOAT, DOUBLE 


long 


NUMBER(20) 


i NUMBER(m,n) 


NUMBER, FLOAT, DOUBLE 


unsigned Long 


NUMBER(20) 


i NUMBER(m,n) 


NUMBER, FLOAT, DOUBLE 


int 


NUMBER(IO) 


i NUMBER(m / n) 


NUMBER, FLOAT, DOUBLE 


unsigned In t 


NUMBER(IO) 


i NUMBER(m / n) 


NUMBER, FLOAT, DOUBLE 


short 


NUMBER(5) 


NUMBER(m,n) 


NUMBER, FLOAT, DOUBLE 


unsigned Short 


NUMBER(5) 


NUMBER(m,n) 


NUMBER, FLOAT/DOUBLE 


byte 


NUMBER(3) 


NUMBER(m,n) 


NUMBER, FLOAT, DOUBLE 


unsigned Byte 


NUMBER(3) 


NUMB£R(m,n) 


NUMBER, FLOAT, DOUBLE 


Table 5-8 Mapping XML Date Datatypes to SQL 


XML Primitive Type 




Default Mapping 


Compatible Datatypes 


datetime 




TIMESTAMP 


DATE 


time 




TIMESTAMP 


DATE 


date 




DATE 


DATE 


gDay 




DATE 


DATE 


gMonth 




DATE 


DATE 


gYear 




DATE 


DATE 



Object-Relational Mapping of XMLType 5-35 



12 



WO 03/030031 



PCT/US02/30783 



XML Schema: Mapping SimpleTypes to SQL 



Table 5-8 Mapping XML Date Datatypes to SQL (Cont.) 


XML Primitive Type 


Default Mapping 


Compatible Datatypes 


gYearMonth 


DATE 


DATE 


gMonthDay 


DATE 


DATE 


duration 


VARCHAR2(4000) 


none 


Table 5-9 Default Mapping of Other XML Primitive Datatypes to SQL 


XML Simple Type 


Default Oracle DataType 


Compatible Datatypes 


boolean 


RAW(l) 


VARCHAR2 


Language(string) 


VARCHAR2(4000) 


CLOB, CHAR 


NMTOKEN(srring) 


VARCHAR2(4000) 


CLOB, CHAR 


NMTOKENS(string) 


VARCHAR2(4000) 


CLOB, CHAR 


Name(string) 


VARCHAR2(4000) 


CLOB, CHAR 


NCName(string) 


VARCHAR2(4000) 


CLOB, CHAR 


ID 


VARCHAR2(4000) 


CLOB, CHAR 


IDREF 


VARCHAR2(4000) 


CLOB, CHAR 


IDREFS 


VARCHAR2(4000) 


CLOB, CHAR 


ENTITY 


VARCHAR2(4000) 


CLOB, CHAR 


ENTITIES 


VARCHAR2(4000) 


CLOB, CHAR 


NOTATION . 


VARCHAR2(4000) 


CLOB, CHAR 


anyURJ 


VARCHAR2(4000) 


CLOB, CHAR 


anyType 


VARCHAR2(4000) 


CLOB, CHAR 


anySimpleType 


VARCHAR2(4000) 


CLOB, CHAR 


QName 


XDB.XDBSQNAME 





simpleType: Mapping XML Strings to SQL VARCHAR2 Versus CLOBs 

If the XML schema specifies the datatype to be string with a maxLength value of 
less than 4000, it is mapped to a VARCHAR2 attribute of the specified length. 
However, if maxLength is not specified in the XML schema, it can only be mapped 
to a LOB. This is sub-optimal when most of the string values are small and only a 
small fraction of them are large enough to need a LOB. See Figure 5. 
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Figure 5-3 Oracle XML DB: Mapping XML Strings to SQL VARCHAR2 or CLOBs 



XML Schema: Mapping ComplexTypes to SQL 

Using XML schema, a complexType is mapped to an SQL object type as follows: 

- XML attributes declared within the complexType are mapped to object 
attributes. The simpleType defining the XML attribute determines the SQL 
datatype of the corresponding attribute. 

. XML elements declared within the complexType are also mapped to object 
attributes. The datatype of the object attribute is determined by the 
simpleType or complexType defining the XML element 

If the XML element is declared with attribute maxOccurs > 1, it is mapped to a 
collection attribute in SQL. The collection could be a VARRAY (default) or 
nested table if the maintainOrder attribute is set to false. Further, the default 
storage of the VARRAY is in Ordered Collections in Tables (OCTs) instead of LOBs. 
You can choose LOB storage by setting the storeAsLob attribute to true. 

See Also: "Ordered Collections in Tables (OCTs) M on page 5-70 
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Mapping complexType to SQL: Setting the SQLInLine Attribute to FALSE for 
Out-of-Line Storage 

By default, a sub-element is mapped to an embedded object attribute. However, 
there may be scenarios where out-of-line storage offers better performance. In such 
cases the SQLInline attribute can be set to false, and Oracle XML DB generates an 
object type with an embedded REF attribute. REF points to another instance of 
XMLType that corresponds to the XML fragment that gets stored out-of-line. Default 
XMLType tables are also created to store the out-oMine fragments. 

Figure 6 illustrates the mapping of a complexType to SQL for out-of-line 
storage. 



Example 5-15 Oracle XML DB XML Schema: complexType Mapping - Setting 
SQLInLine Attribute to False for Out-of-Line Storage 

-- Attribute to False for Out-of-Line Storage 

— In this example element Addr's attribute, xdb : SQLInLine , is set to false. 

— The resulting object type OBJ_T2 has a column of type XMLType with an 
embedded 

— REF attribute. The REF attribute points to another XMLType instance created 
of 

— object type 0EJ_T1 in table Addr_tab. Addr_tab has columns Street and City. 
The latter 
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— XMLType instance is stored cut-of-line. 
declare 

doc varchar2 (3000) := '<schema xmlns="http: //www.w3 .org/2001/XML£chema n 
targetNamespace="http: / /www. oracle .com/ eirp . xsd" 
xmlns : emp="http : / /www. oracle . com/enp . xsd" 
xmlns : xdb= n ht tp : / /xmlns . oracle . com/xdb" > 

<conplexType name = " Employee M xdb:SQL1Vpe="0BJ_T2 n > 
<seqaence> 

<element name = "Name" type = " string" /> 
<element name = "Age" type = "decimal" /> 
<element name = "Addr" xdb:SQLInline = ■ false "> 
<complexType xdb:SQLType="OBJJTl H > 
<sequence> 

<element name = "Street" type = " string" /> 
<element name = "City" type = " string" /> 
</sequence> 
< /complexTVpe> 
</element> 
</sequence> 
</complexType> 
</schema>' ; 
begin. 

6!iTG_xnascheiTa.reg^^ • doc) '> 

end; 

— On registering this XML schema, Oracle XML DB generates the following types 
and XMLType tables: 
CREATE TYPE 0BJ_T1 AS OBJECT 
( 

SYS_XDBPD$ XDB . XDB$RAW_LISTJT, 
Street VARCHAR2(4O00) , 
City VARCHAR2(4000) 

); 

CREATE TYPE OBJ_T2 AS OBJECT 
( 

SYS_XD3PD$ XDB . XDB$RAW_LISTJ\ 
Name VARCHAR2 (4000) , 
Age NUMBER, 
Addr REF XMLType 

); 
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Mapping complexType to SQL: Mapping XML Fragments to Large Objects (LOBs) 

You can specify the SQLType for a complex element as a Character Large Object 
(CLOB) or Binary Large Object (BLOB). Here the entire XML fragment is stored in a 
LOB attribute. This is useful when parts of the XML document are seldom queried 
but are mostly retrieved and stored as single pieces. By storing XML fragments as 
LOBs, you can save on parsing/ decomposition/recomposition overheads. 

Example 5-16 Oracle XML DB XML Schema: complexType Mapping XML Fragments 
to LOBs 

— In the following example, the XML schema specifies that the XML fragment's 
element 

— Addr is using the attribute SQLType = " CLOB " : 
declare 

doc varchar2(3000) := '<scheira xmlns="http: //www.w3 .org/2001/XMLSchema" 
targe tNamespace= ■ http : / /www . oracle . com/emp . xsd" 
xmlns : emp= " http : / /www . oracle . com/emp . xsd" 
xmlns : xdb= n http : / /xmlns . oracle . com/xdb " > 

<carplexType name = "Employee" xdb : SQLType= "03J_T2 " > 
<sequence> 

<element name = "Name" type = " string" /> 
<element name = "Age" type = "decimal" /> 
.<element name = "Addr" xdb: SQLType = "CLOB"> 
<complexiype > 
<sequence> 

<element name - "Street" type = " string "/> 
<element name = "City" type = "string , 7> 
</sequence> 
</complexType> 
</element> 
</sequence> 
</complexType> 
</schema>'; 
begin 

dbms_ J xmlschera . registerSchema ( ' http : / /www. oracle . com/PO . xsd ' , doc ) ; 

end; 

--On registering this XML schema, Oracle XML DB generates the following types 
and XMLType tables: 
CREATE TYPE OBJ_T AS OBJECT 
( 

SYS_XDBPD$ XDB . XDB$RAW_LISTJT , 
Name VARCHAR2 (4000) , 
Age NUMBER, 
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Aridr CLOB 

); 

Figure 7 Mapping complexType XML Fragments to Character Large Objects 
(CLOBs) 



Oracle XML DB complexType Extensions and Restrictions 

In XML schema, complexTypes are declared based on ccmplexContent and 
simpleContent. 

■ simpleContent is declared as an extension of simpleType. 

■ complexContent is declared as one of the following: 

- Base type 

- complexType extension 

- complexType restriction. 

complexType Declarations in XML Schema: Handling Inheritance 

For complexType, Oracle XML DB handles inheritance in the XML schema as 
follows: 

■ For complexTypes declared to extend other complexTypes, the SQL type 
corresponding to the base type is specified as the supertype for the current SQL 
type. Only the additional attributes and elements declared in the 
sub-complextype are added as attributes to the sub-object-type. 
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■ For complexTypes declared to restrict other complexTypes, the SQL type for the 
sub-complex type is set to be the same as the SQL type for its base type. This is 
because SQL does not support restriction of object types through the 
inheritance mechanism. Any constraints are imposed by the restriction in XML 
schema. 

Example 5-17 Inheritance in XML Schema: complexContent as an Extension of 
complexTypes 

— Consider an XML schema that defines a base complexType "Address" and two 
extensions 

-- "USAddress" and "IntlAddress" . 
declare 

doc varchar2 (3000) := '<xs: schema 
xmlns : xs= "http : / /www. w3 . org/200 1/XMLSchema'' 

xmlns : xdb= " http : / /xmlns . oracle . com/xdb" > 
<xs : corrplexType name= "Address" xdb : SQU?ype= " ADDRJT " > 
<xs : sequence> 

<xs : element name= " street" type="xs: string" /> 
<xs : element narre="city" type="xs: string" /> 
</xs : sequence> 
</xs : complexType> 

<xs : corrplexType name= "USAddress " xdb : SQL/Type= "USADDKJT" > " 
<xs : conplexContent> 
<xs .-extension base= "Address "> 
<xs : sequence> 

<xs : element name= M zip" type='*xs: string" /> 
</xs:sequence> 
</xs : extension> 
< /xs : conplexContent> 
</xs : corrplexType> 

<xs: complexType name="IntlAddress" final= B #all n xdb : SQLType= n INTLADDR_T" > 
<xs : complexContent> 
<xs: extension base= "Address '*> 
<xs : sequence> 

<xs: element narre- "country" type= w xs:string'7> 
< /xs : sequence> 
</xs:extension> 
</xs :conplexContent> 
</xs : complexTVpe> 
</xs : schema> ' ; 
begin 

dbrns_xmlschema . regis terSchema ( ' ht tp : / /www . oracle . com/ PO . xsd ' , doc ) ; 
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end; 

— Note: Type INTLADDRJT is created as a final type because the 

— corresponding corpIeXType specifies the "final" attribute. 

— By default, all complextypes can be extended and restricted by 

— other types, and hence, all SQL object types are created as not 

— final types. 

create type ADDRJT as object (• 

SYS_XDBPD$ XDB.XDB$RAWJ^ISTJT, 

"street" varchar2 (4000) , 

"city" varchar2{4000) 
) not final; 

create type USADDR__T under ADDRJT ( 
"zip" varchar2(4000) 
) not final; 

create type INTLADDRJT under ADDRJT { 

"country" varchar2 (4000) 
) final; 

Example 5-75 Inheritance in XML Schema: Restrictions in compiexTypes 

— Consider an XML scheira that defines a base carplexType Address and a 
restricted 

__ type LocalAddress that prohibits the specification of country attribute, 
declare 

doc varchar2(3000} := '<xs: schema 
xmlns : xs= "http : / /www. w3 . org/ 2001 /XMLSchema" 

xmlns : xdb= " ht tp : / /xmlns . oracle . com/xdb" > 
<xs: complexType name=" Address" xdb: SQLiype=" ADDRJT" > 
<xs : sequence> 

<xs: element name =" street" type="xs: string" /> 
<xs: element name= w city" type= n xs: string ■/> 
<xs: element name="zip" type="xs: string" /> 

<xs : element name=" country" type="xs: string" minOccurs="0" maxOccurs= ,, l , '/> 
</xs:sequence> 
</xs : corrplexType> 

<xs:corplexiype name=" LocalAddress" xdb : SQLType= " USADDRJT" > 
<xs : camplexContent> 
<xs : restriction base=" Address " > 
<xs:sequence> 

<xs: element name= n street" type="xs: string" /> 
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<xs : element name="city" type="xs : string" /> 
<xs: element name="zip" type=*xs: string" /> 
<xs : element naive-" country" type="xs: string" 
minOccurs="0 M rraxOccurs= n 0 , 7> 
</xs;sequence> 
</xs : res trie tion> 
< /xs : conplexContent> 
</xs : complexType> 
</xs:schema>' ; 
begin 

dbnis_xml schema . regis terSchema { ' http : //www. oracle . cam/PO . xsd ' , doc) ; 

end; 

— Since inheritance support in SQL does not support a notion of restriction, 

— the SQL type corresponding to the restricted corrplexType is a enpty subtype 

— of the parent object type. For the above XML schema, the following SQL types 

— are generated: 

create type ADDRJT as object ( 

SYS_XDEPD$ XDB . XDB$PAW — LIST_T, 

"street" varchar2 (4000) , 

"city" varchar2 (4000) , 
. "zip" varchar2 (4000) , 

"country" varchar2 (4000) 
) not final; 

create type USADDRJT under ADDRJT; 

Mapping complexType: simpleContent to Object Types 

A complexType based on a simpleContent declaration is mapped to an object 
type with attributes corresponding to the XML attributes and an extra SYS_ 
XDBBODY attribute corresponding to the body value. The datatype of the body 
attribute is based on simpleType which defines the body's type. 

Example 5-19 XML Schema complexType: Mapping complexType simpleContent 

declare 

doc varchar2 (3000) := '<schema xmlns =" http://www.w3 .org/ 2001 /XMLSchema" 
targetNamespace= " http : / /www. oracle . com/enp . xsd" 
xmlns : enp= "http : / /www. oracle . com/enp . xsd" 
xmlns : xdb= "http : / /xmlns . oracle . cam/xdb" > 
<complexType name="naine" xdb : SQLType= ■ OBJ_T rt > 
<sinpleContent> 
restriction base = M string"> 
</restriction> . 
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</simpleContent> 
</conplexTVpe> 
</schema>' ; 
begin 

dims .jxmlschema . regis terSchema ( ' http : / /www . oracle . cam/enp . xsd' , doc ) ; 

end; 

— On registering this XML schema, . Oracle XML DB generates the following types 
and XMLType tables : 

create type OBJ_T as object 
( 

SYS_XDBPD$ xdb . xdb$raw_list_t , 
SYS_XDBBQDY$ VARCHAR2 (4000) 

); 

Mapping complexType: Any and AnyAttributes 

Oracle XML DB maps the element declaration, any, and the attribute declaration, 
anyAttribute, to VARCHAR2 attributes (or optionally to Large Objects (LOBs)) 
in the created object type. The object attribute stores the text of the XML fragment 
that matches the any declaration. 

. The namespace attribute can be used to restrict the contents so that they 
belong to a specified namespace. 

■ The processContents attribute within the any element declaration, indicates 
the level of validation required for the contents matching the any declaration. 

Example 5-20 Oracle XML DB XML Schema: Mapping complexType to 
Any/AnyAttributes 

— This XML scherra exanple declares an any element and maps it to the column 

— SYS_XDRW$ , in object type OBJT. This element also declares that the 

— attribute, processContents , skips validating contents that match the any 

— declaration, 
declare 

doc varchar2 (3000) := '<schema ynuj^="http;//v^.w3.org/2001/XNlLScheira M 
targetNairespace="http: //www. oracle .com/ any .xsd" 
xmlns : emp="http : / /www. oracle . com/ any . xsd" 
xmlns : xdb= " http :/ /xmlns . oracle . com/ xdb " > 
<camplexType name = "Employee" xdb : SQLType= ■ OBJ_T ■ > 
<sequence> 

<element name = "Name" type = "string" /> 
<element name = "Age" type = "decimal "/> 

<any namespace = "http://wwwZw3.org/2001 /xhtml" processContents = "skip"/> 
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</sequence> 
</complexType> 
</schema>' ; 
begin 

dfcms_xmlschenia . regis terSchema ( ' ht tp : / /www . oracle . com/emp . xsd * , doc ) ; 

end; 

--It results in the following statement: 
CREATE TYPE 03J_T AS OBJECT 
( 

SYS_XD3PD$ xdb . xdb$raw_list_t , 
• Naire VARCHAR2 (4000) , 
Age NUMBER, 

SYS_XDBANY$ VARCHAR2 (4000) 

); 

Handling Cycling Between complexTypes in XML Schema 

Cycles in the XML schema are broken while generating the object types, because 
object types do not allow cycles, by introducing a REF attribute at the point at 
which the cycle gets completed. Thus part of the data is stored out-of-line yet still 
belongs to the parent XML document when it is retrieved. 

Example 5-21 XML Schema: Cycling Between complexTypes 

XML schemas permit cycling between definitions of complexTypes. Figure 5-6 
shows this example, where the definition of complexType CT1 can reference 
another complexType CT2, whereas the definition of CT2 references the first type 
CT1. 

— XML schemas permit cycling between definitions of complexTypes .This is an 

example of cycle of length 2: 

declare 

doc varchar2(3000) := '<xs:schema xmlns:xs=" http:/ /www. w3. org/2 001/XMLSchema" 
xmlns : xdb= "http : //xmlns . oracle . com/xdb" > 
<xs: complexType name="CTl" xdb : SQLType= "CTl " > 
<xs : sequence> 

<xs: element name="el M type= "xs : string " /> 
<xs: element name="e2 " type="CT2 n /> 
</xs:sequence> 
</xs : complexrype> 

<xs : corrplexiype name="CT2 n xdb : SQLType= "CT2 " > 
<xs : sequence> 

<xs: element name=' , el" type="xs: string" /> 
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<xs: element naire="e2" type= w CTl n /> 
</xs:sequence> 
</xs : conplexType> 
</xs:schsna>' ; 
begin 

dtms_xmlschema . regis terSchema ( ' http : / /www . oracle . com/enp . xsd ' , doc ) ; 

end; 

SQL types do not allow cycles in type definitions. However, they support weak 
cycles, that is, cycles involving REF (references) attributes. Therefore, cyclic XML 
schema definitions are mapped to SQL object types such that any cycles are avoided 
by forcing SQLlnl ine= "false" at the appropriate poin. This creates a weak cycle. 

For the preceding XML schema, the following SQL types are generated : 
create type CT1 as object 
( 

SYS_XD3FD$ xdb . xdb$raw_lis t_t , 
"el" varchar2{4000), 
M e2" ref xmltype; . 
) not final; 

create type CT2 as object 
( 

SYS_XD3PD$ xdb . xdb$raw_lis t_t , 
w el" varchar2{4000} / 
« e2 « CTl . 
) not final; 

Figure 8 Cross Referencing Between Different compfexTypes in the Same XML 
Schema 
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Example 5-22 XML Schema: Cycling Between complexTypes, Self-Referencing 

— Another example of a cyclic complexType involves the declaration of the 

— complexType having a reference to itself. The following is an 

— exanple of type <SectionT> that references itself: 

declare 

doc varchar2 (3000) := '<xs: schema 
xmlns : xs= ■ ht tp : / /www . w3 . org/ 2 00 1 /XMLSchema " 
xmlns : xdb= u http :/ /xmlns . oracle . com/xdb " > 

<xs: complexType name="SectionT" xdb : SQLType= " SBCTION_T " > 
<xs:sequence> 

<xs: element name= n title" type="xs: string "/> 
<xs: choice maxOccurs= "unbounded" > 

<xs: element name="body" type="xs : string" xdb : SQLCollType= " BODY_COLL n /> 
<xs: element name=" section" type= R SectionT'7> 
</xs:choice> 
</xs : sequence> 
< /xs : complexTVpe> 
</xs:schema>' ; 
begin 

dbms_xmlschema . registerSchema ( ' ht tp : / /www . oracle . com/ section . xsd ' , doc ) ; 

end; 

— The following SQL types are generated. 

— Note: The section attribute is declared as a varray of REFs to XMLiype 

— instances. Since there can be more than one occurrence of embedded sections, 

— the attribute is a VARRAY. And it's a VARRAY of REFs to XMLTypes in order to 

— avoid forming a cycle of SQL objects. 

create type BODY_COLL as varray (32767) of VRRCHAR2 (4000) ; 

create type SEX7TIQN_T as object 
( 

SYS_XDBPD$ xdb.xdb$raw_list_t, 
"title" varchar2(4000), 
"body" BODYjCOLL, 
" section " XD3 . XDB$REF_LIST_T 
) not final; 

Further Guidelines for Creating XML Schema-Based XML Tables 

Assume that your XML schema, identified by "http: //www. oracle.com/PO. xsd" , has 

been registered. An XMLiype table, myPOs, can then be created to store instances 

conforming to element, PurchaseOrder, of this XML schema, in an 

object-relational format as follows: 

CREATE TABLE MyPOs OF XMLIYPE 
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ELEMENT "http: //www. oracle. caVPOiXSdaP^ 

Figure 9 illustrates schematically how a complexTypes can reference or cycle 
itself. 



Figure 9 complexType Self Referencing Within an XML Schema 



Further Guidelines for Creating XML Schema-Based XML Tables 

Assume that your XML schema, identified by 

•http : / /www. oracle . com/PO . xsd", has been registered. An XMLType table, 
myPOs, can then be created to store instances conforming to element, 
PurchaseOrder, of this XML schema, in an object-relational format as follows: 

CREATE TABLE K/POs OF XMLTYPE 

ELEMENT "http: //www. oracle. com/ PO. xsd#PurchaseOder 0 ; 

Hidden columns are created. These correspond to the object type to which the 
PurchaseOrder element has been mapped. In addition, an XMLExtra object 
column is created to store the top-level instance data such as namespace 
declarations. 
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Note: XMLDATA is a pseudo-attribute of XMLType that enables 



Specifying Storage Clauses in XMLType CREATE TABLE Statements 

To specify storage, the underlying columns can be referenced in the XMLType 
storage clauses using either Object or XML notation: 

■ Object notation: XMLDATA. <attrl> . <attr2> . . . . 
For example: 

CREATE TABLE MyPOs OF XMLTYPE 

ELEMENT M ht tp : / /www . oracle . com/ PO . xsd#PurchaseOrder " 
lob (xmldata. lobattr) STORE AS (tablespace ...); 

■ XML notation: extractValue (xmltypecol, ' /attrl/attr2 ' ) 
For example: 

CREATE TABLE MyPOs OF XMLTYPE 

ELEMENT "http: // www.oracle.ccm/PO.xsdSPurchaseOrder" 

lob (ExtractValue(lfyPOs, '/lobattr')) STORE AS (tablespace ...); 



Referencing XMLType Columns Using CREATE INDEX 

As shown in the preceding examples, columns underlying an XMLType column can 
be referenced using either an object or XML notation in the CREATE TABLE 
statements. The same is true in CREATE INDEX statements: 

CREATE INDEX ponum_idx ON MyPOs (xmldata.ponum) ; 

CREATE INDEX ponum_idx ON MyPOs p (ExtractValue (p, '/ponum') ; 

Specifying Constraints on XMLType Columns 

Constraints can also be specified for underlying XMLType columns, using either the 
object or XML notation: 

■ Object notation 

CREATE TABLE ffyPOs OF XMLTYPE 

ELEMENT "http: // www. oracle. com/ FO.xsd#PurchaseOrder n 
(unique (xmldata.ponum) ) ; 
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■ XML notation 

CREATE TABLE MyPOs P OF XMLTYPE 
ELEMENT 

"http: / /www . oracle . com/PO . xsd#PurchaseOrder " (unique (ExtractValue(p, ' /ponum' ) 
); 

Inserting New Instances into XMLType Columns 

New instances can be inserted into an XMLType columns as follows: 

INSERT INTO MyPOs VALUES 

(xmltype . createxml { ' <PurchaseQrder> </PurchaseOrder> ' ) ) ; 

Query Rewrite with XML Schema-Based Object-Relational Storage 
What is Query Rewrite? 

When the XMLType is stored in structured storage (object-relationally) using an 
XML schema and queries using XPath are used, they are rewritten to go directly to 
the underlying object-relational columns. This enables the use of B*Tree or other 
indexes, if present on the column, to be used in query evaluation by the Optimizer. 
This query rewrite mechanism is used for XPath's in SQL functions such as 
existsNode ( ) , extract < ) , extractValue { ) , and updateXML ( ) . This 
enables the XPath to be evaluated against the XML document without having to 
ever construct the XML document in memory. 

Example 5-23 Query Rewrite 
For example a query such as: 

SELECT VALUE (p) FROM MyPOs p 

WHERE extractValue (value (p) , 1 /PurchaseOrder /Corpany ' } = 'Oracle' ; 

is trying to get the value of the Company element and compare it with the literal 
'Oracle'. Since the MyPOs table has been created with XML schema-based 
object-relational storage, the extractValue operator gets rewritten to the 
underlying relational column which stores the company information for the 
purchaseorder. 

Thus the preceding query is rewritten to the following: 

SELECT VALUE(p) FRCM MyPOs p 
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WHERE p . xmldata . ccfipany = 'Oracle'; 

If there was a regular index created on the Company column, such as: 

CREATE INDEX corpany_index ON MyPos e 

(extractvalue (value (e) , ' /PurchaseOrder/Carrpany' ) ) ; 

then the preceding query would use the index for its evaluation; 

When Does Query Rewrite Occur? 

Query rewrite happens for the following SQL functions, 

■ extract () 

■ existsNodeO 

■ extractvalue 
• updateXML 

The rewrite happens for these SQL functions which may be present in any 
expression in a query, DML, or DDL statements. For example, you can use the 
extractvalue ( ) to create indexes on the underlying relational columns. 

Example 5-24 SELECT Statement and Query Rewrites 

— This exairple gets the existing purchase orders 

SELECT EXTRACTVALUE (value (x) , ' /PurchaseOrder/Conpany' ) 
FROM MYPOS x 

WHERE EXISTSNODE ( value (x) , '/PurchaseQrder/Itemll]/Part' ) = 1; 

Here are some examples of statements that get rewritten to use the underlying 
columns: 

Example 5-25 DML Statement and Query Rewrites 

— This exanple deletes all purchaseorders where the conpany is not Oracle: 
DELETE FROM MYPOs x 

WHERE EXTRACTVALUE (value (x) , '/PurchaseOrder/Carrpany' ) = 'Oracle Corp' ; 
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Example 5-26 CREATE INDEX Statement and Query Rewrites 

«- This exanple creates an index on the Company column - since this is stored 

— object relationally and the query rewrite happens, a regular index on the 

— underlying relational column will be created: 

CREATE INDEX conpany_index ON MyPos e 

(extractvalue (value (e) , ' / PurchaseOrder /Corpany ' ) ) ; 

In this case, if the rewrite of the SQL functions results in a simple relational column, 
then the index is turned into a BTree or a domain index on the column, rather than a 
function-based index. 



What XPath Expressions are Rewritten? 

XPath involving simple expressions with no wild cards or descendant axes get 
rewritten. The XPath may select an element or an attribute node. Predicates are 
supported and get rewritten into SQL predicates. 

Table 5-10 lists the kinds of XPath expressions that can be translated into 
underlying SQL queries in this release. 



Table 5-10 Supported XPath Expressions For Translation to Underlying SQL Queries 



XPath Expression for Translation Description 



Simple XPath expressions: 

/PurchaseOrder/@PurchaseDate 

/PurchaseOrder/Company 



Involves traversal over object type attributes only where the attributes 
are simple scalar or object types themselves. The only axes supported 
are the child and the attribute axes. 



Collection traversal expressions: 
/PurchaseOrder/Item/Part 



Involves traversal of collection expressions. The only axes supported are 
child and attribute axes. Collection traversal is not supported if the SQL 
operator is used during CREATE INDEX or updateXML ( ) . 



Predicates: 
[Company ="Orade"] 



Predicates in the XPath are rewritten into SQL predicates. Predicates are 
not rewritten for updateXML ( ) 



List indexe: 
lineitem[l] 



Indexes are rewritten to access the n'th item in a collection. These are 
not rewritten for updateXML { ) . 



Unsupported XPath Constructs The following XPath constructs do not get rewritten: 

■ XPath Functions 

■ XPath Variable references 
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■ All axis other than child and attribute axis 

■ Wild card and descendant expressions 

■ UNION operations 

Unsupported XMLSchema Constructs The following XML Schema constructs are not 
supported. This means that if the XPath expression includes nodes with the 
following XML Schema construct then the entire expression will not get rewritten: 

■ XPath expressions accessing children of elements containing open content, 
namely any content. When nodes contain any content, then the expression 
cannot be rewritten, except when the any targets a namespace other than the 
namespace specified in the XPath. any attributes are handled in a similar way. 

■ CLOB storage. If the XML schema maps part of the element definitions to an 
SQL CLOB, then XPath expressions traversing such elements are not supported. 

■ Enumeration types. 

■ Substitutable elements. 

Non-default mapping of scalar types. For example, number types mapped to native 
storage, such as native integers, and so on. 

■ Child access for inherited complexTypes where the child is not a member of 
the declared complexType. 

For example, consider the case where we have a address complexType 
which has a street element. We can have a derived type called shipAddr 
which contains shipment Number element. If the PurchaseOrder had an 
address element of type address, then an XPath like 
"/PurchaseOrder/address/street- would get rewritten whereas 
VPurchaseOrder/address/shipmentNumber " would not. 

■ Non-coercible datatype operations, such as a boolean added with a number. 

How are the XPaths Rewritten? 

The following sections use the same purchaseorder schema explained earlier in 
the chapter to explain how functions get rewritten. 

Example 5-27 Rewrting XPaths During Object Type Generation 

— Consider the following purchaseorder scherra : 

declare 
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doc varchar2( 1000) ' <schema 
targetNamespace="http : / /www . oracle . cam/ PO . xsd" 

xmlns : po= "http : / /www . oracle . cam/PO . xsd n xmlns= "http : / /www . w3 . org/ 2001/XMLSchema" 
elementFormDef ault= " qualified" > 
<canplexType name= " PurchaseOrderType " > 
<seqaence> 
<eleirent riame^PQNum" type= "decimal *7> 
<elerrent name="Carpany"> 
<simpleType> 

restriction base=" string^ 
<rraxLength value="100"/> 
</restriction> 
</simpleType> 
</element> 

<element name= n Item" maxOccnrs= n 1000 l, > . . 

<camplexType> 
<sequence> 
<eleirent name=°Part"> 
<siirpleTVpe> 
restriction base= "string'^ 
<maxLength valuer" 1000 "/> 
< /restrict ion> 
</simpleType> 
</element> 

<element name= B Price" type=" float " /> 
</sequence> 
</corplexrrype> 
</element> 
</sequence> 
</camplexType> 

<element name= 0 Pur chaseOrder ■ type= ,T po: PurchaseOrderType "/> 
</schema>'; 
begin 

dbms_xmlschema. regis terScherra( 'http: / /www. oracle.com/PO. xsd' , doc) ; 

end; 

— A table is created conforming to this schema 
CREATE TABLE MyPOs OF XMLTYPE 

ELEMENT "http: //www. oracle .cam/PO. xsd# Pur chaseOrder" ; 

— The inserted XML document is partially validated against the schema before 

— it is inserted. 

insert into MyPos values (xmltype ( ' < Pur chaseOrder 
xmlns= M http : / /www. oracle . cam/ PO . xsd" 



Object-Relational Mapping of XMLType 5-55 



92 



WO 03/030031 



PCT/US02/30783 



Query Rewrite with XML Schema-Based Object-Relational Storage 



xmlns :xsi= M http: //www.w3 . org/2001/XMLSchema- instance" 
xsi : schemaLocation= "http : / /www . oracle . cam/PO. xsd 
http : / /www . oracle . com/PO . xsd" > 
<POto>1001</PONum> 
<Conpany>Oracle Corp< /CQrrpany> 
<Item> 

<Part>9i Doc Set</Part> 
<Price>2550</Price> 
</Item> 
<Item> 
<Part>8i Doc Set</Part> 
<Pr ice>3 5 0< / Price> 
</Iterrs> 
</PurchaseQrder>' ) ) ; 

Since the XML schema did not specify anything about maintaining the ordering, the 
default is to maintain the ordering and DOM fidelity. Hence the types have SYS_ 
XDBPD$ attribute to store the extra information needed to maintain the ordering of 
nodes and to capture extra items such as comments, processing instructions and so 
on. 

The SYS_XDBPD$ attribute also maintains the existential information for the 
elements (that is, whether the element was present or not in the input document). 
This is needed for elements with scalar content, since they map to simple relational 
columns. In this case, both empty and missing scalar elements map to NULL 
values in the column and only the SYS_XDBPD$ attribute can help distinguish the 
two cases. The query rewrite mechanism takes into account the presence or absence 
of the SYS_XDBPD$ attribute and rewrites queries appropriately. 

Assuming that this XML schema is registered with the schema URL: 

http: //www. oracle. com/PO. xsd 

you can create the po_tab table with that schema: 

CREATE TABLE po_tab OF XMLTYPE 

XMLSCHEMA "http: //www. oracle. cam/ PO. xsd" ELEMENT "PurchaseOrder" ; 

Now, this table has a hidden XMLData column that is of type "PurchaseOrderJT" 
which stores the actual data. 

Rewriting XPath Expressions: Mapping Types and Issues 

XPath expression mapping types and topics are described in the following sections: 
■ "Mapping for Simple XPath" 
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■ "Mapping for Scalar Nodes" 

■ "Mapping of Predicates" 

■ "Mapping of Collection Predicates" 

■ 'Document Ordering with Collection Traversals" 
. "Collection Index" 

■ "Non-Satisfiable XPath Expressions" 

■ "Namespace Handling" 

■ "Date Format Conversions" 

Mapping for Simple XPath A rewrite for a simple XPath involves accessing the 
attribute corresponding to the XPath expression. Table 5-11 lists the XPath map: 

Table 5-t 1 Simple XPath Mapping for purchaseOrder XML Schema 



XPath Expression 


Maps to 




/PurchaseOrder 


column XMLData 




/PurchaseOrder/© PurchaseDate 


column XMLData.'PurchaseDate" 




/PurchaseOrder/PONum 


column XMLData/PONum" 




/PurchaseOrder/ltem 


elements of the collection XMLData. Item" 




/PurchaseOrder/ltem/Part 


attirbute Tart" in the collection XMLData. "item" 





Mapping for Scalar Nodes An XPath expression can contain a text ( ) operator which 
maps to the scalar content in the XML document. When rewriting, this maps 
directly to the underlying relational columns. 

For example, the XPath expression "/PurchaseOrder/PONum/textO" maps to 
the SQL column XMLData. "PONum" directly. 

A NULL value in the PONum column implies that the text value is not available, 
either because the text node was not present in the input document or the element 
itself was missing. This is more efficient than accessing the scalar element, since we 
do not need to check for the existance of the element in the SYS_XBDPD$ attribute. 

For example, the XPath '7 PurchaseOrder/ PONum" also maps to the SQL 
attribute XMLData . n PONum", 
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However,in this case, query reqrite also has to check for the existance of the element 
itself, using the SYS_XDBPD$ in the XMLData column. 

Mapping of Predicates Predicates are mapped to SQL predicate expressions. 
Example 5-28 Maping Predicates 

— For exanple the predicate in the XPath expression: 

/PurchaseOrder[PQNum=1001 and Corrpany = "Oracle Corp"] 

— maps to the SQL predicate: 

( XMLData. "PONum" = 20 and XMLData . "Corrpany" = "Oracle Corp") 

— For exanple, the following query will get rewritten to the object-relational 

— equivalent, and will not require Functional evaluation of the XPath. 
select extract (value (p) , ' /PurchaseOrder/Item' ) .getClobvalO 

from rnypos p 

where existsNode (value (p) , VPurchaseOrder [P0Num=1001 and Corrpany = "Oracle 
Corp"]') =1; 

Mapping of Collection Predicates XPath expressions may involve relational operators 
with collection expressions. In Xpath 1.0, conditions involving collections are 
existential checks. In other words, even if one member of the collection satisfies the 
condition, the expression is true. 

Example 5-29 Mapping Collection Predicates 

For exanple the collection predicate in the XPath: 
/PurchaseOrder[ Items/Price > 200] 

— maps to a SQL collection expression: 
EXISTS ( SELECT null 

FRCM TABLE (XMLDATA . " Item" ) x 
WHERE x. "Price" > 200 ) 

— For exanple, the following query will get rewritten to the object-relational 

— equivalent. 

select extract (value (p) , ' /PurchaseOrder/Item' ) .getClobvalO 
from rnypos p 

where existsNode (value (p) , '/PurchaseOrder [Item/ Price > 400]') = 1; 

More complicated rewrites occur when you have a collection <condition> 
collection. In this case, if at least one combination of nodes from these two collection 
arguments satisfy the condition, then the predicate is deemed to be satisfied. 
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Example 5-30 Mapping Collection Predicates, Using existsNodeQ 

— For example, consider a fictitious XPath which checks to' see if a 

— Purchaseorder has Items such that the price of an item is the same as 

— some part- number: 

/ PurchaseOrder [ I terns / Price = Items/Part] 

— maps to a SQL collection expression: 
EXISTS ( SELECT null 

FROM TABLE (XMLDATA. "Item") x 
• WHERE EXISTS ( SELECT null 

FROM TABLE ( XMLDATA , " Item" ) y 
WHERE y.°Part" = x. "Price")) 

For example, the following query will get rewritten to the object-relational 

— equivalent. 

select extract (value (p) , ' /PurchaseQrder/Item' ) .getClobval ( ) 
from mypos p 

where existsNode {value (p) , ' /PurchaseOrder [Item/Price = Item/Part]'} = 1; 

Document Ordering with Collection Traversals Most of the rewrite preserves the original 
document ordering. However, since the SQL system does not guarantee ordering on 
the results of subqueries, when selecting elements from a collection using the 
extract ( ) function, the resultant nodes may not be in document order. 

Example 5-31 Document Ordering with Collection Traversals 

— For example: 

SELECT extract (value(p) , ' /PurchaseOrder/ 1 tern [Price>2 100] /Part' ) 
FROM mypos p; 

— gets rewritten to use subqueries as shown below: 
SELECT (SELECT XMLAgg( XMLForest (x. "Part" AS "Part")) 

FROM TABLE (XMLData . "Item" ) X 
WHERE x. "Price" > 2100 ) 
FROM po_tab p; 

Though in most cases, the result of the aggregation would be in the same order as 
the collection elements, this is not guaranteed and hence the results may not be in 
document order. This is a limitation that may be fixed in future releases. 

Collection Index An XPath expression can also access a particular index of a 
collection For example, "/ PurchaseOrder /I tem[l] / Part" is rewritten to 
extract out the first Item of the collection and then access the Part attribute within 
that. 
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If the collection has been stored as a VARRAY, then this operation retrieves the 
nodes in the same order as present in the original document. If the mapping of the 
collection is to a nested table, then the order is undetermined. If the VARRAY is 
stored as an Ordered Collection Table (OCT) , (the default for the tables created by 
the schema compiler, if s toreVarrayAsTable= " true " is set), then this collection 
index access is optimized to use the IOT index present on the VARRAY. 

Non-Salisfiable XPath Expressions An XPath expression can contain references to 
nodes that cannot be present in the input document. Such parts of the expression 
map to SQL NULLs during rewrite. For example the XPath expression: 
" / PurchaseOrder /ShipAddr ess" cannot be satisified by any instance 
document conforming to the PO . xsd XML schema, since the XML schema does not 
allow for ShipAddress elements under PurchaseOrder. Hence this expression 
would map to a SQL NULL literal. 

Namespace Handling Namespaces are handled in the same way as the function-based 
evaluation. For schema based documents, if the function (like 
EXISTSNODE/EXTRACT) does not specify any namespace parameter, then the 
target namespace of the schema is used as the default namespace for the XPath 
expression. 

Example 5-32 Handling Namespaces 

-- For exarrple, the XPath expression / PurchaseOrder /PONum is treated as 

— /a : PurchaseOrder /a : PONum with xmins:a="http://v. i ww. oracle.com/PO. xsd" if 

— the SQL function does not explicitly specify the namespace prefix and 
mapping. In other words: 

SELECT * FROM po_tab p 

WHERE EXISTSNODE (value (p) , '/ PurchaseOrder/ PONum ' ) = 1; 

— is equivalent to the query: 
SELECT * FROM po_tab p 

WHERE EXISTSNODE (value (p) , ' /PurchaseOrder /PONum' , 
'xmlns="http: //www. oracle. cam/PO. xsd' ) = 1; 

When performing query rewrite, the namespace for a particular element is matched 
with that of the XML schema definition. If the XML schema contains 
elementFormDefault== M qualif ied" then each node in the XPath expression 
must target a namespace (this can be done using a default namespace specification 
or by prefixing each node with a namespace prefix). 

If the elementFormDef ault is unqualified (which is the default), then only the 
node that defines the namespace should contain a prefix. For instance if the PO . xsd 
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had the element form to be unqualified, then the existsNode ( ) function should 
be rewritten as: 

EXISTSNODE (value {p) , ' /a : PurchaseQrder/PCNum'., 

' mLns:a="http://www. oracle, com/ PO.xsd") = 1; 



Note: For the case where elementFormDe fault is unqualified, 
omitting the namespace parameter in the SQL function 
existsNode ( ) in hte preceding example, would cause each node 
to default to the target namespa. This would not match the 
XMLSchema definition and consequently would not return any 
result. This is true whether the function is rewritten or not. 



Date Format Conversions The default date formats are different for XML schema and 
SQL. Consequently, when rewriting XPath expressions involving companions with 
dates, you need to use XML formats. 

Example 5-33 Date Format Conversions 

— For exairple, the expression: 
[@ParchaseDate="2002-02-01" ]' 

— cannot be sijrply rewritten as: 
XMLData . n PurchaseDate" = " 2002-02-01" 

— since the default date format for SQL is not YYYY-MM-EO . Hence during 

— rewrite, the XML format string is added to convert text values into date 

— datatypes correctly. 

Thus the preceding predicate would be rewritten as: 

XMLData. "PurchaseDate" = TO_DATE ( "2002-02-01 \ "SYYYY-MM-DD") ; 

Similarly when converting these columns to text values (needed for extract ( ) , 
and so on), XML format strings are added to convert them to the same date format 
as XML. 

XPath Expression Rewrites for existsNode() 

exi s t sNode { ) returns a numerical value 0 or 1 indicating if the XPath returns any 
nodes (text ( ) or element nodes). Based on the mapping discussed in the earlier 
section, an exis tsNode simply checks if a scalar element is non-nuU in the case 
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where the XPath targets a text ( ) node or a non-scalar node and checks for the 
existance of the element using the SYS_XDBPD$ otherwise. If the SYS_XDBPD$ 
attribute is absent, then the existance of a scalar node is determined by the null 
information for the scalar column. 

existsNode Mapping with Document Order Maintained Table 5-12 shows the mapping of 
various XPaths in the case of exis t sNode ( ) when document ordering is 
preserved, that is, when SYS_XDBPD$ exists and maintainDOM= " true" in the 
schema document. 



Table 5-12 XPath Mapping for existsNodef) with Document Ordering Preserved 



XPath Expression 


Maps to 


/PurchaseOrder 


CASE WHEN XMLData IS NOT NULL THEN 1 ELSE 0 END 


/PurchaseOrder/® PurchaseDate 


CASE WHEN Check_NodeJxists(XMLData.SYSJ<DBPD$/PurchaseDate') =1 




THEN 1 ELSE 0 END 


/PurchaseOrder/PONum 


CASE WHEN Check_Node_Exists(XMLData.SYS_XDBPD$,'PONum') =1 




THEN 1 ELSE 0 END 


/Purcha$e0rder[PONum = 2100] 


CASE WHEN XMLData/PONum' = 2100 THEN 1 ELSE 0 


/PurchaseOrder[PONum = 


CASE WHEN XMLData.TONum 0 = 2100 AND 


2100]/@PurchaseDate 


Check Jtode_Exists(XMLData.SYS_XDBPD$, 'PurchaseDate') = 1 




THEN 1 ELSE 0 END 


/PurchaseOrder/PONum/textQ 


CASE WHEN XMLData/PONum" IS NOT NULL THEN 1 ELSE 0 


/PurchaseOrder/ltem 


CASE WHEN EXISTS ( 




SELECT NULL FROM TABLE ( XMLData.ltem 11 ) x 




WHERE value(x) IS NOT NULL ) THEN 1 ELSE 0 END 


/PurchaseOrder/Item/Part 


CASE WHEN EXISTS ( 




SELECT NULL FROM TABLE ( XMLData.ltem" ) x 




WHERE Check_Node_Exists(x.SYS_XDBPD$, 'Part') = 1 ) 




THEN 1 ELSE 0 END 


/PurchaseOfder/ltem/Part/text() 


CASE WHEN EXISTS ( 




SELECT NULL FROM TABLE ( XMLData."ltem" ) x 




WHERE x.Tart* IS NOT NULL) THEN 1 ELSE 0 END 
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Example 5-34 existsNode Mapping with Document Order Maintained 

— Using the preceding napping, a query which checks whether the purchaseorder 

— with number 2100 contains a part with price greater than 2000: 
SELECT count (*) 

FROM rnypos p 

WHERE EXISTSNODE (value (p) / /PurchaseQrder[PCNuin=1001 and Item/Price > 2000] ') = 
1; 

— would become: 
SELECT count {*) 
FROM rnypos p 
WHERE CASE WHEN 

p.XMLData."PCNum n = 1001 AND 

EXISTS ( SELECT NULL 

FROM TABLE ( XMLData. "Item") p 

WHERE p. "Price" > 2000 )) THEN 1 ELSE 0 END = 1; 

— The CASE egression gets further optimized due to the constant relational 
-- equality expressions and this query becomes: 

SELECT count (*) 
FROM rnypos p 

WHERE p. XMLData. "PQNum" = 1001 AND 
EXISTS ( SELECT NULL 

FROM TABLE ( p. XMLData. "Item" ) x 
WHERE x. -Price" > 2000 ); 

— which would use relational indexes for its evaluation, if present on the Part 
and PONum columns. 

existsNode Mapping Without Maintaining Document Order If the sys_xdbpd$ does not 
exist (that is, if the XML schema specifies main tainDOM= "false " ) then NULL 
scalar columns map to non-existant scalar elements. Hence you do not need to 
check for the node existance using the SYS_XDBPD$ attribute. Table 5-13 shows the 
mapping of existsNode ( ) in the absence of the SYS_XDBPD$ attribute. 



Table 5-13 XPath Mapping for existsNode Without Document Ordering 



XPath Expression 


Maps to 


/PurchaseOrder 


CASE WHEN XMLData IS NOT NULL THEN 1 ELSE 0 END 


/PurchaseOrder/@PurchaseDate 


CASE WHEN XMLData.'PurchaseDate'lSNOTNULL THEN 1 ELSE 0 END 


/PurchaseOrder/PONum 


CASE WHEN XMLData.TONum" IS NOT NULL THEN 1 ELSE 0 END 


/PurchaseOrderfPONum = 2100] 


CASE WHEN XMLData.'PONum" = 2100 THEN 1 ELSE 0 END 
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Table 5-13 XPath Mapping for existsNode Without Document Ordering (Cont.) 


XPath Expression 


Maps to 


/PurchaseOrder[PONum = 


CASE WHEN XMLData. B PONum B = 2100 AND 


2100]/@ PurchaseOrderDate 


XMLData. u PurchaseDate" NOT NULL THEN 1 ELSE 0 END 


/PurchaseOrder/PONum/textO 


CASE WHEN XMLData/'PONum" IS NOT NULL THEN 1 ELSE 0 END 


/PurchaseOrder/ltem 


CASE WHEN EXISTS ( 




SELECT NULL FROM TABLE ( XMLData/ltem" ) x 




WHERE value(x) IS NOT NULL ) THEN 1 ELSE 0 END 


/PurchaseOrder/item/Part 


CASE WHEN EXISTS ( 




SELECT NULL FROM TABLE ( XMLData.ltem" ) x 




WHERE x. u Parf IS NOT NULL) THEN 1 ELSE 0 END 


/PurchaseOrder/ltem/Part/text() 


CASE WHEN EXISTS ( 




SELECT NULL FROM TABLE ( XMLData.ltem" ) x 




WHERE x.'Part" IS NOT NULL) THEN 1 ELSE 0 END 



Rewrite for extractVa!ue() 

extrac t Value ( ) is a shortcut for extracting text nodes and attributes using 
extract ( ) and then using a getStr ingVal ( > or getNumberVal ( ) to get the 
scalar content. extractValue returns the text nodes for scalar elements or the 
values of attribute nodes. extractValue ( ) cannot handle returning multiple 
values or non-scalar elements. 

Table 5-14 shows the mapping of various XPath expressions in the case of 
extractValue(). If an XPath expression targets an element, extractValue retrieves 
the text node child of the element. Thus the two XPath expressions, 
/PurchaseOrder/PONumand /PurchaseOrder/PONum/text ( ) are handled 
identically by extractValue and both of them retrieve the scalar content of 
PONum. 



Table 5-14 XPath Mapping for extractValuef) 


XPath Expression 


Maps to 


/PurchaseOrder 


Not supported - ExtractValue can only retrieve values for scalar 




elements and attributes 


/PurchaseOrder/® PurchaseDate 


XMLData.TurchaseDate" 


/PurchaseOrder/PONum 


XMLData.'PONum 0 
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Table 5-74 XPath Mapping for extractValuef) (Cont) 



XPath Expression 


Maps to 


/PurchaseOrder[PONum = 2100] 


(SELECT TO XML(x.XMLData) FROM Dual WHERE x.TONum' = 




2100) 


/PurchaseOrder[PONum = 


(SELECT x.XMLData.TurchaseDate") 


2100]/@PurchaseDate 


FROM Dual 




WHERE x.TONum" = 2100) 


/PurchaseOrder/PONum/textO 


XMLData.TONum" 


/PurchaseOrder/ltem 


Not supported • ExtractValue can only retrieve values for scalar 




elements and attributes 


/PurchaseOrder/ltem/Part 


Not supported - ExtractValue cannot retireve multiple scalar values 


/Pu rchaseOrder/ltem/Part/textO 


Not supported - ExtractValue cannot retireve multiple scalar values 



Example 5-35 Rewriting extractValueQ 

— For example, an SQL query such as: 

SELECT ExtractValue (value (p) , ' / PorchaseOrder / POta ' ) 
FROM rnypos p 

WHERE ExtractValue (value (p) , ' /PurchaseOrder/PQNum' ) = 1001; 

— would become: 
SELECT p.XMLData. "PQNum" 

FROM rnypos p 

WHERE p.XMLData. "POI^um" = 1001; 

Since it gets rewritten to simple scalar columns, indexes if any, on the PONum 
attribute may be used to satisfy the query. 

Creating Indexes ExtractValue can be used in index expressions. If the expression 
gets rewritten into scalar columns, then the index is turned into a BTree index 
instead of a function-based index. 

Example 5-36 Creating Indexes 

— For exairple: 

create index ny_po_index on rnypos x 

(Extract (value (x) , ' / PurchaseCrder / PQNum/ text ( ) ' ) .getnumberval ( ) ) ; 

— would get rewritten into: 

create index nr/_po_index on rnypos x ( x.XMLData. "PONum") ; 
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— and thus becomes a regular BTree index. This is useful, since 

— unlike a functional index, the same index can now satisfy queries which 
target the column such as: 

EXISTSNQDE (value (x) , ' /PurchaseOrder [ PONum=1001 ] ' ) = 1 ; 

— and thus becomes a regular B*Tree index, this is useful, since 

— unlike a functional index, the same index can now satisfy queries which 
target the column such as: 

EXISTSNQDE (value (x) , ' /PurchaseOrder [ PQNum=1001 ] ' ) = 1 ; 

Rewrite for extract() 

extract ( ) retrieves the results of XPath as XML. The rewrite for extract ( ) is 
similar to that of extractValue ( ) for those Xpath expressions involving text 
nodes. 

Extract Mapping with Document Order Maintained Table 5-15 shows the mapping of 
various XPath in the case of extract ( ) when document order is preserved (that is, 
when SYS_XDBPD$ exists and maintainDOM= " true " in the schema document). 



Note: The examples show XMLElement and XMLForest with an 
empty alias string "" to indicate that you create a XML instance with 
only text values. This is shown for illustration only. 



Table 5-15 XPath Mapping for extractQ with Document Ordering Preserved 



XPath 


Maps to 


/PurchaseOrder 


XMLForest(XMLData as "PurchaseOrder 8 ) 


/PurchaseOrder/® PurchaseDate 


CASE WHEN Check_Node.Exists(XMLData.SYS^XDBPD$ f 'PurchaseDate] = 1 




THEN XMLEIementr.XMLData.TurchaseDate 0 ) ELSE NULL END 


/PurchaseOrder/PONum 


CASE WHEN Check.Node.ExistslXMLData.SYS.XDBPDS.'PONum') =1 




THEN XMLEIement("PONum" , XMLData/PONum") ELSE NULL END 


/PurchaseOrder[PONum = 2100] 


( SELECT XMLForest(XMLData as "PurchaseOrder") 




FROM Dual 




WHERE x.'PONum' = 2100) 
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Table 5-15 XPath Mapping for extractQ with Document Ordering Preserved (Cont.) 



XPath 


Maps to 


/PurchaseOrder[PONum = 2100]/@PurchaseDate 


( SELECT CASE WHEN 




Check^Node_Exists(x.XMLData.SYS.XDBPD$;PurchaseDate ,, ) = 1 




THEN XMLE1ement(", XMLData-'PurchaseDate") 




ELSE NULL END 




FROM Dual 




WHERE x.TONum" = 2100) 


/PurchaseOrder/PONum/text() 


XMLEIementf, XMLData.PONum) 


/PurchaseOrder/ltem 


( SELECT XMLAgg(XMLForest(value(p) as "Item")) 




FROM TABLE ( x.XMLData. B ltem" ) p 




WHERE value(p) IS NOT NULL) 


/PurchaseOrder/ltem/Part 


( SELECT XMLAggf 




CASE WHEN CheclLNode.Exis!s(|xSYS_XDBPD$;Part - ) = 1 




THENXMLForest(p.°Part B as'Part B ) ELSE NULL END) 




FROM TABLE ( x.XMLData."llem" ) p) 


/PurchaseOrder/ltenVPart/textQ 


( SELECT XMLAgg(XMLEIement( B B , p.'Part") ) 




FROM TABLE ( x.XMLData.'ltem" ) x ) 



Example 5-37 XPath Mapping for extractQ with Document Ordering Preserved 

— Using the mapping in Table 5-15, a query that extracts the PONum element 

— where the purchaseorder contains a part with price greater than 2000: 
SELECT Extract (value (p) / /PurchaseOrder [Item/Part > 2000] /PCton' ) 

FROM po_tab p; 



— would became: 

SELECT (SELECT CASE WHEN Check_Nbde^Exists {p.XMLCata.SYSJOBPD$, 'PODJum') = 1 
THEN XMLElement { " PCNum" , p.XMLData. "PONum" ) 
ELSE NULL END) 

FROM DUAL 

WHERE EXISTS ( SELECT NULL 

FROM TABLE ( XMLData . " Item" } p 
. WHERE p. "Part" > 2O00) 

) 

FROM po_tab p; 

— Check_Node_E>cists is an internal function that is for illustration purposes 
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— only. 

Extract Mapping Without Maintaining Document Order If the SYS_XDBPD$ does not exist, 
that is, if the XML schema specifies maintainDOM= " false " , then NULL scalar 
columns map to non-existant scalar elements. Hence you do not need to check for 
the node existance using the SYS_XDBPD$ attribute. Table 5-16 shows the mapping 
of existsNode ( ) in the absence of the SYS_XDBPD$ attribute. 



Table 5-16 XPath Mapping for extractf) Without Document Ordering Preserved 



XPath 


Equivalent to 


/PurchaseOrder 


XMLForest{XMLData AS "PurchaseOrder") 


/PurchaseOrder/® PurchaseDate 


XMLForest(XMLData.'PurchaseDate" AS ") 


/PurchaseOrder/PONum 


XMLForest(XMLData. M PONum" AS "PONum") 


/PurchaseOrder(PONum = 2100] 


( SELECT XMLFore$i(XMLData AS "PurchaseOrder") 




FROM Dual 




WHERE x. "PONum" = 2100) 


/PurchaseOrder[PONum = 


( SELECT XMLForest(XMLData.VurchaseDate B AS "") 


21 00]/@ PurchaseDate 


FROM Dual 




WHERE X-TONum-r 2100) 


/PurchaseOrder/PONum/iext() 


XMLForest(XMLData.PONum AS "") 


/PurchaseOrder/ltem 


( SELECT XMLAgg(XMLForest(value(p) as "Item") 




FROM TABLE ( x.XMLData.ltem" ) p 




WHERE value(p)ISNOTNULL) 


/PurchaseOrder/item/Part 


( SELECT XMLAgg(XMLForest(p.'Paif AS Tart") 




FROM TABLE ( x.XMLData/ltem" ) p) 


/PurchaseOrder/ltem/Part/text() 


( SELECT XMLAgg( XMLForest(p. "Part" AS "Part") ) 




FROM TABLE ( x.XMLData.ltem" ) p ) 



Optimizing Updates Using updateXML() 

A regular update using updateXML ( ) involves updating a value of the XML 
document and then replacing the whole document with the newly updated 
document. 

When XMLType is stored object relationally, using XML schema mapping, updates 
are optimized to directly update pieces of the document. For example, updating the 
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PONum element value can be rewritten to directly update the XMLData.PONum 
column instead of materializing the whole document in memory and then 
performing the update. 

updateXML ( ) must satisfy the following conditions for it to use the optimization: 
. The XMLType column supplied to updateXML ( ) must be the same column 

being updated in the SET clause. For example: 

UPDATE po_tab p SET value (p) = updatexnd (valua(p) ,...); 

i The XMLType column must have been stored object relationally using Oracle 

XML DB's XML schema mapping. 
■ The XPath expressions must not involve any predicates or collection traversal. 
. There must be no duplicate scalar expressions. 

. All XPath arguments in the updateXML ( ) function must target only scalar 
content, that is, text nodes or attributes - For example: 

UPDATE po_tab p SET value (p) = 

updatexml (value (p) , ' /PurchaseOrder/@PurchaseDate' , '2002-01-02' , 
'/PurchaseOrder/PCMmt/textO', 2200); 

If all the preceding conditions are satisfied, then the updateXML is rewritten into a 
simple relational update. For example, 

UPDATE po_tab p SET value (p) = 

updatexml {value (p) , ' /PurcraseOrder/@PurchaseBate' , '2002-01-02' , 
VParchaseOrder/PONum/textO \ 2200); 

becomes, 

UPDATE pO__tab p 

SET p.XMLData."PurchaseDate n = TO_DATE { ' 2002-01-02 ' , ' SYYYY-MM-DD' ) , 
p.XMLData. n PGNum" = 2100; 

DATE Conversions Date datatypes such as Date, gMonth, gDate etc., have different 
format in the XMLSchema and SQL system. In such cases, if the updateXML has a 
string value for these columns, the rewrite automatically puts the XML format 
string to convert the string value correctly. Thus string value specified for date 
columns, must match the XML date format and not the SQL date format. 
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Creating Default Tables During XML Schema Registration 

As part of XML schema registration, you can also create default tables. Default 
tables are most useful when XML instance documents conforming to this XML 
schema are inserted through APIs that do not have any table specification, such as 
with FTP or HTTP. In such cases, the XML instance is inserted into the default table. 

If you have given a value for attribute def aul tTable, the XMLType table is 
created with that name. Otherwise it gets created with an internally generated 
name. 

Further, any text specified using the tableProps and columnProps attribute are 
appended to the generated CREATE TABLE statement. 

Ordered Collections in Tables (OCTs) 

Arrays in XML schemas (elements with raaxOccurs > 1) are usually stored in 
VARRAYs, which can be stored either in a Large Object (LOB) or in a separate store 
table, similar to a nested table. 



Note: When elements of a VARRAY are stored in a separate table, 
the VARRAY is referred to as an Ordered Collection in Tables 
(OCT). In the following paragraphs, references to OCT also assume 
that you are using Index Organized Table (IOT) storage for the 
"store" table. 

This allows the elements of a VARRAY to reside in a separate table based on an IOT. 
The primary key of the table is (NESTEDJTABLE JD, ARRAY_INDEX). NESTED^ 
TABLE JD is used to link the element with their containing parents wliile the 
ARR AY JNDEX column keeps track of the position of the element within the 
collection. 

Using OCT for VARRAY Storage 

There are two ways to specify an OCT storage: 

□ By means of the schema attribute w storeVarrayAsTable". By default this is 
"false" and VARRAYs are stored in a LOB. If this is set to w true", all 
VARRAYs, all elements that have maxOccurs > 1, will be stored as OCTs. 
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■ By explicitly specifying the storage using the "tableProps" attribute. The 
exact SQL needed to create an OCT can be used as part of the tableProps 
attribute: 

"VARRAY xmlc3ata.<array> STORE AS TABLE <myTable> ( (PRIMARY KEY (NESTSD„ 
' TABLE_H) / ARRAY_INDEX) ) ORGANIZATION INDEX) " 

The advantages of using OCTs for VARRAY storage include faster access to 
elements and better queriability. Indexes can be created on attributes of the element 
and these can aid in better execution for query rewrite. 

Cyclical References Between XML Schemas 

XML schema documents can have cyclic dependencies that can prevent them from 
being registered one after the other in the usual manner. Examples of such XML 
schemas follow: 

Example 5-38 Cyclic Dependencies 

— A schema thats including another schema cannot be created 
-- if the included schema does not exist. 

begin dfcn\s_xrnl schema . register Schema ( ' xm40 . xsd' , 

'<schema xmlns= "http://www.w3 .org/2001/XMLSchema" xmlns:nry= ,, xm40 B 

targetNamespace= "xm40 " > 

<include schenaLocation="xm40a .xsd tt /> 
<!— Define a global ccfnplextype here — > 
<complexType name= n Conp3ny"> 
<sequence> 

<element name="Name" type="string , V> 
<element name= "Address" type="string'7> 
</sequence> 
</ccjrplexType> 

<!— Define a global element depending on included schema — > 
<element name=°Emp" tr/pe= u rm/: Employee" /> 
</schema> , , 

true, true, false, true) ; end; 
/ 

— It can however be created with the FORCE option 
begin dtms_xmlschema . registerSchema { ' xm40 . xsd ' , 

'<schema x^up^= ^ htt^://www.w3.org/2001/XMLSchema ,, xmlns:my= t, xm40 M 
targe tNamespace= "xm40 " > 
< include schemaLocation= n xm40a.xsd n /> 



Object-Relational Mapping of XMLType 5-71 



108 



WO 03/030031 



PCTAJS02/30783 



Cyclical References Between XML Schemas 



<! — Define a global canplextype here — > 
<canplexType name="Corrpany n > 
<sequence> 

<element name= t, Name B type= "string '7 > 
<elemsnt name=" Address " type= n string "/> 
</ sequence* 
</camplexType> 

<!— Define a global element depending on included schema — > 
<element name= M Emp" type="my : Employee" /> 
</schema>' , 

true, true, false, true, true); end; 

/ . 

— Attempt to use this schema will try recompiling 

— and fail. 

create table foo of sys.xmltype xmlschema H xm40.xsd n element tt Emp"; 

— Now create the 2nd schema with FORCE option 

— This should also make the 1st schema VALID. 

begin dbms jxmlschema . register Schema ( ' xm40a . xsd' , 
'<schema xmlns= M http://www.w3 .org/ 2001 /XMLSchema" xmlns:my="xm40" 
targetNamespace= "xm40 "> 
<include schemaLocation="xm40 .xsd" /> 
<! — Define a global complextype here — > 
<canplexType name= M Employee n > 
<sequence> 

<element name="Naire" type=" string" /> 
<element name="Age" type= r, positiveInteger w /> 
<element name=" Phone" type= n stringV> 
</sequence> 
</complexiype> 

<!— Define a global element depending on included schema — > 
<element name="Conp" type="my: Company ■/> 
</schema>', 

true, true, false, true, true); end; 
/ 

— Both can be used to create tables etc. 

create table foo of sys.xmltype xmlschema n xm40.xsd" element "Qrp"; 
create table foo2 of sys.xmltype xmlschema "xm40a.xsd" element "Camp"; 

To register both these XML schemas which have a cyclic dependency on each other, 
you must use the FORCE parameter in DBMS — XMLSCHEMA . regis terSchema as 
follows: 
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Step 1 : Register "sl.xsd" in FORCE mode: - 

c3ritis_xiTaschera . registerSchema (" si .xsd" , "<schema » • » " force => true) 

At this point, sl.xsd is invalid and cannot be used. 
Step 2 : Register "s2.xsd" in FORCE mode: 

oli ra ^scheira.registerSchanna("£2.xsd\ -<scha» force => true) 

The second operation automatically compiles si .xsd and makes both XML 
schemas valid. 
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CLAIMS 

What is claimed is: 

1. A.method for managing data in a database system, the method comprising the 
steps of: 

determining, within a database system, an appropriate database representation for 
storing within said database system documents that conform to an XML 
schema; 

generating mapping data that indicates correlations between elements of said 
XML schema and elements of said appropriate database representation. 

2. The method of Claim 1 wherein: 

the step of determining an appropriate database representation includes 

determining, based on user-specified information, that an element of said 
XML schema is to be mapped to a single CLOB without generating other 
object types within said database system for said element; and 

the step of generating mapping data includes generating data that maps said 
element to said single CLOB. 

3. The method of Claim 2 further comprising the step of receiving said user- 
specified information in the form of user-specified annotations to said XML schema. 

4. The method of Claim 1 wherein: 

the step of determining an appropriate database representation includes 

determining, based on user-specified information, that a first set of 
subelements of an element of said XML schema is to be mapped to a 
single CLOB; and 

the step of generating mapping data includes generating data that maps said first 
set of subelements to said single CLOB, and generating data that maps a 
second set of subelements of said element to one or more objects other 
than said CLOB. 

5. The method of Claim 1 wherein the step of determining an 
appropriate database representation includes mapping datatypes associated 
with elements in said XML schema to datatypes supported by said database 
system. 
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6. The method of Claim 1 wherein the step of determining an appropriate database 
representation includes defining an SQL object type that includes attributes that 
correspond to elements in said XML schema. 

7. The method of Claim 5 wherein the step of mapping datatypes includes the steps 
of: 

if a particular datatype associated with an element in said XML schema is 

associated with a first length, then mapping said particular datatype to a 
first database datatype; and 

if said particular datatype is associated with a second length, then mapping said 
particular datatype to a second database datatype, wherein the first 
database datatype is different than said second database datatype. 

8. The method of Claim 5 wherein the step of determining an appropriate database 
representation includes mapping a particular element of said XML schema to a collection 
type supported by the database system if the particular element is defined to have a 
maximum number of occurrences greater than one. 

9. The method of Claim 8 wherein the collection type is an array type, wherein the 
cardinality of the array type is selected based on the maximum number of occurrences 
specified for said particular database element. 

10. The method of Claim 1 wherein the step of constraint determining an appropriate 
database representation includes defining a constraint in said appropriate database 
representation based upon a constraint specified in said XML schema for an element of 
said XML schema. 

11. The method of Claim 10 wherein the step of defining a constraint includes 
defining a constraint from a set consisting of: a uniqueness constraint, a referential 
constraint, and a not null constraint. 

12. The method of Claim 1 wherein: 

a first datatype is associated with an element in the XML schema; 
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the XML schema specifies that said first datatype inherits from a second datatype; 
and 

the step of determining an appropriate database representation includes defining 
within said database system a subtype of an object type, wherein said 
object type corresponds to said second datatype. 

13. The method of Claim 1 wherein the step of determining appropriate database 
representation includes: 

mapping a first set of elements in said XML schema to database structures that 

maintain each element separate in the first set separate from the other 

elements in the first set; and 
mapping a second set of elements in said XML schema to a database structure in 

which all elements in said second set of elements are combined as a single 

undifferentiated database element. 

14. The method of Claim 13 wherein the database system determines membership of 
said first set and membership of said second set based on directives associated with said 
XML schema. 

15. The method of Claim 1 3 wherein elements in the first set of elements are selected 
to be in said first set based on a likelihood that said elements will be accessed more 
frequently than the elements selected to be in said second set of elements. 

16. The method of Claim 1 wherein: 

the steps of determining an appropriate database representation and generating 
mapping data are preformed as part of an XML schema registration 
operation that causes modifications within said database system; and 

the method further comprises the step of automatically removing all modifications . 
caused by said XML schema registration operation in response to 
encountering a particular error during said XML schema registration 
operation. 

17. The method of Claim 1 wherein the step of determining an appropriate database 
representation includes determining how to break cycles in said XML schema. 
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18. The method of Claim 1 wherein: 

said XML schema includes a cycle involving a plurality of components; and 
the step of determining how to break cycles includes causing each component of 
the cyclic definition to holds pointers to all of its children components. 

19. The method of Claim 1 wherein the step of determining how to break cycles 
includes causing an entire cyclic definition to be mapped for storage as a single CLOB 
within the database system. 

20. The method of Claim 1 wherein the step of generating mapping data includes 
adding annotations to said XML schema, and storing said annotated XML schema within 
said database system. 

21. The method of Claim 1 further comprising the steps of: 

creating structures within a database based on said appropriate database 
representation; and 

storing in said structures data from XML documents that conform to said XML 
schema. 

22. The method of Claim 21 wherein the step of storing data from XML documents 
includes the steps of: 

receiving an XML document at said database system; 

identifying data, from said XML document, that is associated with individual 

elements of said XML schema; 
storing the data associated with individual elements at locations within said 

structures based on 

the elements associated with the data, and 
the mapping data. 

23. The method of Claim 1 further comprising the step of validating, within said 
database system, said XML schema to determine whether the XML schema conforms to 
an XML schema for XML schemas. 
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24. The method of Claim 1 wherein the step of determining is performed as part of an 
XML schema registration operation that is initiated in response to receiving, at said 
database server, said XML schema. 

25. The method of Claim 1 wherein the step of determining is performed as part of an 
XML schema registration operation that is initiated in response to receiving, at said 
database server, an XML document that conforms to said XML schema. 

26. The method of Claim 24 wherein: 

the XML schema includes user-specified annotations that indicate how the 

database system should map at least one element of the XML schema; and 
at least a portion of the mapping data reflects said user-specified annotations. 

27. A computer-readable medium carrying instructions for managing data in a 
database system, the instructions comprising instructions which, when executed by one or 
more processors, cause the processors to perform the steps of: 

determining, within a database system, an appropriate database representation for 
storing within said database system documents that conform to an XML 
schema; 

generating mapping data that indicates correlations between elements of said 
XML schema and elements of said appropriate database representation. 

28. The computer-readable medium of Claim 27 wherein the step of 
determining an appropriate database representation includes mapping 
datatypes associated with elements in said XML schema to datatypes 
supported by said database system. 

29. The computer-readable medium of Claim 27 wherein the step of determining an 
appropriate database representation includes defining an SQL object type that includes 
attributes that correspond to elements in said XML schema. 

30. The computer-readable medium of Claim 28 wherein the step of mapping 
datatypes includes the steps of: 
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if a particular datatype associated with an element in said XML schema is 

associated with a first length, then mapping said particular datatype to a 
first database datatype; and 

if said particular datatype is associated with a second length, then mapping said 
particular datatype to a second database datatype, wherein the first 
database datatype is different than said second database datatype. 

3 1. The computer-readable medium of Claim 28 wherein the step of determining an 
appropriate database representation includes mapping a particular element of said XML 
schema to a collection type supported by the database system if the particular element is 
defined to have a maximum number of occurrences greater than one. 

32. The computer-readable medium of Claim 31 wherein the collection type is an 
array type, wherein the cardinality of the array type is selected based on the maximum 
number of occurrences specified for said particular database element. 

33. The computer-readable medium of Claim 27 wherein the step of constraint 
determining an appropriate database representation includes defining a constraint in said 
appropriate database representation based upon a constraint specified in said XML 
schema for an element of said XML schema. 

34. The computer-readable medium of Claim 33 wherein the step of defining a 
constraint includes defining a constraint from a set consisting of: a uniqueness constraint, 
a referential constraint, and a not null constraint. 

35. The computer-readable medium of Claim 27 wherein: 

a first datatype is associated with an element in the XML schema; 
the XML schema specifies that said first datatype inherits from a second datatype; 
and 

the step of determining an appropriate database representation includes defining 
within said database system a subtype of an object type, wherein said 
object type corresponds to said second datatype. 
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36. The computer-readable medium of Claim 27 wherein the step of determining 
appropriate database representation includes: 

mapping a first set of elements in said XML schema to database structures that 

maintain each element separate in the first set separate from the other 

elements in the first set; and 
mapping a second set of elements in said XML schema to a database structure in 

which all elements in said second set of elements are combined as a single 

undifferentiated database element. 

37. The computer-readable medium of Claim 36 wherein the database system 
determines membership of said first set and membership of said second set based oh 
directives associated with said XML schema. 

38. The computer-readable medium of Claim 36 wherein elements in the first set of 
elements are selected to be in said first set based on a likelihood that said elements will be 
accessed more frequently than the elements selected to be in said second set of elements. 

39. The computer-readable medium of Claim 27 wherein: 

the steps of determining an appropriate database representation and generating 
mapping data are preformed as part of an XML schema registration 
operation that causes modifications within said database system; and 

the computer-readable medium further comprises instructions for performing the 
step of automatically removing all modifications caused by said XML 
schema registration operation in response to encountering a particular error 
during said XML schema registration operation. 

40. The computer-readable medium of Claim 27 wherein the step of determining an 
appropriate database representation includes determining how to break cycles in said 
XML schema. 

41. The computer-readable medium of Claim 27 wherein the step of generating 
mapping data includes adding annotations to said XML schema, and storing said 
annotated XML schema within said database system. 
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42. The computer-readable medium of Claim 27 further comprising instructions for 
performing the steps of: 

creating structures within a database based on said appropriate database 
representation; and 

storing in said structures data from XML documents that conform to said XML 
schema. 

43. The computer-readable medium of Claim 42 wherein the step of storing data from 
XML documents includes the steps of: 

receiving an XML document at said database system; 

identifying data, from said XML document, that is associated with individual 

elements of said XML schema; 
storing the data associated with individual elements at locations within said 

structures based on 

the elements associated with the data, and 
the mapping data. 

44. The computer-readable medium of Claim 27 further comprising instructions for 
performing the step of validating, within said database system, said XML schema to 
determine whether the XML schema conforms to an XML schema for XML schemas. 

45. The computer-readable medium of Claim 27 wherein the step of determining is 
performed as part of an XML schema registration operation that is initiated in response to 
receiving, at said database server, said XML schema. 

46. The computer-readable medium of Claim 27 wherein the step of determining is 
performed as part of an XML schema registration operation that is initiated in response to 
receiving, at said database server, an XML document that conforms to said XML schema. 

47. The computer-readable medium of Claim 45 wherein: 

the XML schema includes user-specified annotations that indicate how the 

database system should map at least one element of the XML schema; and 
at least a portion of the mapping data reflects said user-specified annotations. 
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FIG. 4 



XML data: employee_2002.xml 

< employ ee> 

<f irst_name>Scott</f irst_name> 
<last_r.ame>Tiger</last_naine> 
<email>scott . itger@oracle . com</email> 

<hire_date>040402</hir©_date> 

<depar tmen t _i d> 1 2 3 4 < / depar cmen t_i d> 
</employee> 

XML schema definition: employee.xsd 

<sequence> , 

<element nair.e- " first name" Cype= n string /> 
<element name-" last name" type= "string" /> 
< element name=" email " type= " string "/> 

<eiement name="hire_date B type= "date" /> 

<element name =" d epart men t__id" type = integer" /> 
</sequence> 

Store as CLOB 



Create 
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XMLType Column 
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Store 

Object-relatlonally 
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scott 


tiger 
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Here the whole XML document or parts 
of it are stored In CLOBs In tables. 



Here the XML elements are mapped 
to columns in tables. 
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FIG. 5 



<element 



name = "Resume" type = "string"> 

■ 

i 
i 



Employee_tab of type OBJ_T 

Resume 



CLOB-i 



Entire resume 
value is stored 
in the CLOB 
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FIG. 6 



<element 



name = "Addr" xdb : SQLInLine = "false"> 

■ 
I 
I 
I 



Employ 

Name 


ree_tal 

Age 


3 of type OBJ_T2 

Addr REF XMLType 



















REF points 
to another 
XMLType 
instance 



This XML fragment is 
stored out-of-line 
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FIG. 7 



<element name = "Addr" xdb : SQLType = H CLOB"> 
■ 

i 
i 
i 

* 

Employee_tab of type OBJ_T 



Name 


Age 


Addr 






CLOB^ 











Street and 
city are stored 
in the CLOB 
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FIG. 8 



1 XML schema, emp. xsd 



9 <xs:complexType name= 
g "CT1"...> 



<xs:element name= 
"e2" type = "CT27> 



x 



8 
9 

<xs:complexType name= l 
"CT2"...> \ 

i 
0 



<xs:element name= 
"e2"type="CT17> 
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FIG. 9 



J XML schema, emp. xsd 

9 <xs:complexType narne= 

9 "SectionT\..> 
3 



9 

3 <xs:element name="section" type = 
« M SectionT7> 
3 



(I 
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FIG. 10 



